在我退回之后试图找出如何访问我的数据。如果我打印它,这是x的样本:
<_GatheringFuture finished result=[[{'ip': '173.245.203.70'}], [{'ip': '196.52.2.82'}], [{'ip': '69.161.4.1'}], [{'ip':'73.180.140.205'}], [{'ip': '96.242.181.128'}], [{'ip': '108.208.74.183'}], ...]>
我尝试过x [0],x.result,x.results等等......但只是不断出错。任何人都知道如何访问Future结果中的数据?感谢您的时间!以下是完整的代码:
import asyncio
from bs4 import BeautifulSoup
from aiohttp import ClientSession
HEADERS = {'user-agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36'}
proxy = 'xxx.xxx.xxx.xxx:xxxxx'
async def fetch(url, session):
while True:
x = []
try:
async with session.get(url, headers=HEADERS, proxy="http://{}".format(proxy), timeout=9) as r:
print (r.status)
if r.status == 200:
data = await r.read()
soup = BeautifulSoup(data, 'html.parser')
for ip in soup.select('tr + tr td font'):
array.append({'ip' : ip.get_text()})
break
except:
pass
return x
async def bound_fetch(sem, url, session):
async with sem:
return await fetch(url, session)
async def run(num):
tasks = []
sem = asyncio.Semaphore(300)
async with ClientSession() as session:
for i in range(0,num):
task = asyncio.ensure_future(bound_fetch(sem, 'http://ip4.me', session))
tasks.append(task)
responses = asyncio.gather(*tasks)
await responses
return responses
if __name__ == '__main__':
loop = asyncio.get_event_loop()
future = asyncio.ensure_future(run(10))
x = loop.run_until_complete(future)
loop.close()
print (x)
答案 0 :(得分:4)
此处responses
返回的是您从asyncio.gather
获得的未来:
responses = asyncio.gather(*tasks)
await responses
return responses
你想要的是这个未来的结果。像这样改变你的代码:
responses = await asyncio.gather(*tasks)
return responses