如何根据请求映射grequests响应?

时间:2019-01-25 06:12:51

标签: python grequests

我写了一个python代码来使用grequests发送异步请求,如何检查这是哪个请求的响应?响应的顺序与发送的顺序相同吗?

这是我的代码:

import grequests
import time

start_time = time.time()

q_values = [1,2,3,4,5,6,7,8,9,10]

headers = {"User-Agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:63.0) Gecko/20100101 Firefox/63.0", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "Accept-Language": "en-US,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Connection": "close", "Upgrade-Insecure-Requests": "1"}
rs = (grequests.get("https://www.google.com?query="+str(u) , headers=headers) for u in q_values)


rs = grequests.map(rs,size=10)

for r in rs:
 print r

我需要这样的输出:

q_value 1 response code is <Response [200]>
q_value 2 response code is <Response [200]>
q_value 3 response code is <Response [200]>
q_value 4 response code is <Response [200]>

2 个答案:

答案 0 :(得分:0)

好吧,我用grequests钩子做到了,这是我的答案:

import grequests
import time

start_time = time.time()

q_values = [1,2,3,4,5,6,7,8,9,10]

def do_something(response, *args, **kwargs):
    url = response.url
    print (url+ " : " +str(response))


headers = {"User-Agent": "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:63.0) Gecko/20100101 Firefox/63.0", "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "Accept-Language": "en-US,en;q=0.5", "Accept-Encoding": "gzip, deflate", "Connection": "close", "Upgrade-Insecure-Requests": "1"}
rs = (grequests.get("https://www.google.com?query="+str(u) , headers=headers, hooks = {'response' : do_something}) for u in q_values)


rs = grequests.map(rs,size=10)

任何专家都可以确认它是正确的吗?

答案 1 :(得分:0)

在响应对象中,它还根据响应存储请求对象

No