如何为正在运行的asyncio循环添加新的协同程序? IE浏览器。已经执行一套协程的那个。
我想作为一种解决方法,可以等待现有协程完成,然后初始化一个新循环(使用附加协程)。但是有更好的方法吗?
答案 0 :(得分:16)
您可以使用create_task
来安排新的协同程序:
import asyncio
async def cor1():
...
async def cor2():
...
async def main(loop):
await asyncio.sleep(0)
t1 = loop.create_task(cor1())
await cor2()
await t1
loop = asyncio.get_event_loop()
loop.run_until_complete(main(loop))
loop.close()
答案 1 :(得分:13)
要向已经运行的事件循环添加函数,您可以使用:
asyncio.ensure_future(my_coro())
在我的情况下,我在threading
旁边使用多线程(asyncio
),并希望将一个任务添加到已经运行的事件循环中。对于处于相同情况的其他任何人,请务必明确说明事件循环(因为Thread
内不存在)。即:
在全球范围内:
event_loop = asyncio.get_event_loop()
然后,在Thread
:
asyncio.ensure_future(my_coro(), loop=event_loop)
答案 2 :(得分:8)
您的问题非常接近"如何为正在运行的程序添加函数调用?"
什么时候需要在事件循环中添加新的协同程序?
让我们看一些例子。这里的程序用两个协同程序并行启动事件循环:
import asyncio
from random import randint
async def coro1():
res = randint(0,3)
await asyncio.sleep(res)
print('coro1 finished with output {}'.format(res))
return res
async def main():
await asyncio.gather(
coro1(),
coro1()
) # here we have two coroutines running parallely
if __name__ == "__main__":
loop = asyncio.get_event_loop()
loop.run_until_complete(main())
输出:
coro1 finished with output 1
coro1 finished with output 2
[Finished in 2.2s]
您可能需要添加一些可以获得coro1
结果的协同程序,并在它准备就绪后立即使用它吗?在这种情况下,只需创建等待coro1
并使用它返回值的协程:
import asyncio
from random import randint
async def coro1():
res = randint(0,3)
await asyncio.sleep(res)
print('coro1 finished with output {}'.format(res))
return res
async def coro2():
res = await coro1()
res = res * res
await asyncio.sleep(res)
print('coro2 finished with output {}'.format(res))
return res
async def main():
await asyncio.gather(
coro2(),
coro2()
) # here we have two coroutines running parallely
if __name__ == "__main__":
loop = asyncio.get_event_loop()
loop.run_until_complete(main())
输出:
coro1 finished with output 1
coro2 finished with output 1
coro1 finished with output 3
coro2 finished with output 9
[Finished in 12.2s]
将coroutines视为具有特定语法的常规函数。你可以启动一些函数来并行执行(通过asyncio.gather
),你可以在第一次完成后启动下一个函数,你可以创建调用其他函数的新函数。
答案 3 :(得分:7)
如果任务是将协程添加到已经在执行一些协程的循环中,那么您可以使用我的这个解决方案
import asyncio
import time
from threading import Thread
from random import randint
# first, we need a loop running in a parallel Thread
class AsyncLoopThread(Thread):
def __init__(self):
super().__init__(daemon=True)
self.loop = asyncio.new_event_loop()
def run(self):
asyncio.set_event_loop(self.loop)
self.loop.run_forever()
# example coroutine
async def coroutine(num, sec):
await asyncio.sleep(sec)
print(f'Coro {num} has finished')
if __name__ == '__main__':
# init a loop in another Thread
loop_handler = AsyncLoopThread()
loop_handler.start()
# adding first 5 coros
for i in range(5):
print(f'Add Coro {i} to the loop')
asyncio.run_coroutine_threadsafe(coroutine(i, randint(3, 5)), loop_handler.loop)
time.sleep(3)
print('Adding 5 more coros')
# adding 5 more coros
for i in range(5, 10):
print(f'Add Coro {i} to the loop')
asyncio.run_coroutine_threadsafe(coroutine(i, randint(3, 5)), loop_handler.loop)
# let them all finish
time.sleep(60)
执行此示例后,我们将获得以下输出:
Add Coro 0 to the loop
Add Coro 1 to the loop
Add Coro 2 to the loop
Add Coro 3 to the loop
Add Coro 4 to the loop
Coro 0 has finished
Adding 5 more coros
Add Coro 5 to the loop
Add Coro 6 to the loop
Add Coro 7 to the loop
Add Coro 8 to the loop
Add Coro 9 to the loop
Coro 1 has finished
Coro 3 has finished
Coro 2 has finished
Coro 4 has finished
Coro 9 has finished
Coro 5 has finished
Coro 7 has finished
Coro 6 has finished
Coro 8 has finished
Process finished with exit code 0
答案 4 :(得分:1)
这里没有一个答案似乎可以完全回答这个问题。通过让“父级”任务为您完成任务,可以将任务添加到正在运行的事件循环中。我不确定确保父项直到子项全部完成后才结束的最有效方式(假设这是您想要的行为),但这确实有效。
import asyncio
import random
async def add_event(n):
print('starting ' + str(n))
await asyncio.sleep(n)
print('ending ' + str(n))
return n
async def main(loop):
added_tasks = []
delays = [x for x in range(5)]
# shuffle to simulate unknown run times
random.shuffle(delays)
for n in delays:
print('adding ' + str(n))
task = loop.create_task(add_event(n))
added_tasks.append(task)
await asyncio.sleep(0)
print('done adding tasks')
# make a list of tasks that (maybe) haven't completed
running_tasks = added_tasks[::]
# wait until we see that all tasks have completed
while running_tasks:
running_tasks = [x for x in running_tasks if not x.done()]
await asyncio.sleep(0)
print('done running tasks')
# extract the results from the tasks and return them
results = [x.result() for x in added_tasks]
return results
loop = asyncio.get_event_loop()
results = loop.run_until_complete(main(loop))
loop.close()
print(results)