卷曲到Scrapy请求

时间:2019-06-27 19:42:46

标签: python curl scrapy

我有一个有效的curl请求,可以从终端使用它来获得响应,

curl 'https://staticw2.yotpo.com/batch' --data 'methods=%5B%7B%22method%22%3A%22reviews%22%2C%22params%22%3A%7B%22page%22%3A2%2C%22host-widget%22%3A%22main_widget%22%2C%22pid%22%3A%22662869508141%22%7D%7D%5D&app_key=9Xl4sVrD22kwfKsvy23ri7keOV41RekeaL5WoDRi&is_mobile=false&widget_version=2019-06-17_07-32-56'

但是,我不知道如何使它成为我的抓抓蜘蛛的有效Scrapy.Request(https://docs.scrapy.org/en/latest/topics/request-response.html)(特别是--data部分使我发疯)。< / p>

我已经遵循了How to extract data that loads differently with scrapy的建议

从'https://curl.trillworks.com/'到典型的Python request的curl解析器失败。

不确定下一步如何尝试。

帮助先感谢

0 个答案:

没有答案