如何访问Gathering Future完成结果中的数据

时间:2018-02-16 14:51:05

标签: python-3.x future python-asyncio aiohttp concurrent.futures

在我退回之后试图找出如何访问我的数据。如果我打印它,这是x的样本:

<_GatheringFuture finished result=[[{'ip': '173.245.203.70'}], [{'ip': '196.52.2.82'}], [{'ip': '69.161.4.1'}], [{'ip':'73.180.140.205'}], [{'ip': '96.242.181.128'}], [{'ip': '108.208.74.183'}], ...]>

我尝试过x [0],x.result,x.results等等......但只是不断出错。任何人都知道如何访问Future结果中的数据?感谢您的时间!以下是完整的代码:

import asyncio
from bs4 import BeautifulSoup
from aiohttp import ClientSession

HEADERS = {'user-agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36'}
proxy = 'xxx.xxx.xxx.xxx:xxxxx'

async def fetch(url, session):
 while True:
  x = []
  try:
   async with session.get(url, headers=HEADERS, proxy="http://{}".format(proxy), timeout=9) as r:
    print (r.status)
    if r.status == 200:
     data = await r.read()
     soup = BeautifulSoup(data, 'html.parser')
     for ip in soup.select('tr +  tr td font'):
      array.append({'ip' : ip.get_text()})
     break
  except:
   pass
 return x

async def bound_fetch(sem, url, session):
 async with sem:
  return await fetch(url, session)

async def run(num):
 tasks = []
 sem = asyncio.Semaphore(300)

 async with ClientSession() as session:
  for i in range(0,num):
   task = asyncio.ensure_future(bound_fetch(sem, 'http://ip4.me', session))
   tasks.append(task)

  responses = asyncio.gather(*tasks)
  await responses
  return responses

if __name__ == '__main__':
 loop = asyncio.get_event_loop()
 future = asyncio.ensure_future(run(10))
 x = loop.run_until_complete(future)
 loop.close()
 print (x)

1 个答案:

答案 0 :(得分:4)

此处responses返回的是您从asyncio.gather获得的未来:

responses = asyncio.gather(*tasks)
await responses
return responses

你想要的是这个未来的结果。像这样改变你的代码:

responses = await asyncio.gather(*tasks)
return responses