我有一个有效的curl请求,可以从终端使用它来获得响应,
curl 'https://staticw2.yotpo.com/batch' --data 'methods=%5B%7B%22method%22%3A%22reviews%22%2C%22params%22%3A%7B%22page%22%3A2%2C%22host-widget%22%3A%22main_widget%22%2C%22pid%22%3A%22662869508141%22%7D%7D%5D&app_key=9Xl4sVrD22kwfKsvy23ri7keOV41RekeaL5WoDRi&is_mobile=false&widget_version=2019-06-17_07-32-56'
但是,我不知道如何使它成为我的抓抓蜘蛛的有效Scrapy.Request(https://docs.scrapy.org/en/latest/topics/request-response.html)(特别是--data
部分使我发疯)。< / p>
我已经遵循了How to extract data that loads differently with scrapy的建议
从'https://curl.trillworks.com/'到典型的Python request
的curl解析器失败。
不确定下一步如何尝试。
帮助先感谢