在异步def循环执行程序中完成请求后,如何添加请求参数?

时间:2019-01-18 15:38:33

标签: python python-requests python-asyncio

如何将verifyproxies之类的参数添加到下面的requests.get中?

在非异步设置中,我只会做requests.get(url, proxies='some_proxy', verify=False),但我不知道如何将其放在下面。

import asyncio
import concurrent.futures
import requests

ids = [2048854772, 2042055933, 2036234693, 2007740886, 2006259847, 2003100744]
token = '111111'
max_workers = len(ids)

async def main():
    with concurrent.futures.ThreadPoolExecutor(max_workers=max_workers) as executor:
        loop = asyncio.get_event_loop()
        futures = [
            loop.run_in_executor(
                executor, 
                requests.get, 
                'https://www.strava.com/api/v3/activities/{id}?include_all_efforts=true&access_token={token}'.format(id=id, token=token)
            )
            for id in ids
        ]
        for response in await asyncio.gather(*futures):
            print(response.text)
            pass

loop = asyncio.get_event_loop()
loop.run_until_complete(main())

1 个答案:

答案 0 :(得分:3)

您可以使用partial

from functools import partial

def sum(a, b):
    return a + b

sum_with_two = partial(sum, 2)
sum_with_two(5)
>>> 7

sum_two_and_four = partial(sum, 2, 4)
sum_two_and_four()
>>> 6

在您的情况下:

my_request = partial(requests.get, proxies='...', verify=False)

loop.run_in_executor(
    executor, 
    my_request,  # Arguments of the partials will be used 
    '...url...'
)