如何从同步代码Python调用异步函数

时间:2018-08-09 08:29:05

标签: python asynchronous python-3.6 fme

因此,我被锁定在桌面应用程序之后的python 3.6.2解释器中。

我想要从同步的方法或函数中调用异步函数。

从桌面应用程序调用python函数时,它必须是无法等待的普通函数。

我可以从桌面应用程序发送一个URL列表,而我想要的是在异步情况下从每个URL发送回响应。

这是我的尝试,我已将SyntaxError标记为我不知道如何绕过。

import fmeobjects
import asyncio
import aiohttp
import async_timeout
logger = fmeobjects.FMELogFile()
timeout = 10

class FeatureProcessor(object):
    def __init__(self):
        pass
    def input(self, feature):
        urls_and_coords = zip(feature.getAttribute('_list{}._wms'),\
        feature.getAttribute('_list{}._xmin'),\
        feature.getAttribute('_list{}._ymin'),\
        feature.getAttribute('_list{}._xmax'),\
        feature.getAttribute('_list{}._ymax'))
        -> SyntaxError: newfeature = await main(urls_and_coords)
        self.pyoutput(newfeature)

    def close(self):
       pass 

async def main(urls):
    loop = asyncio.get_event_loop()
    async with aiohttp.ClientSession(loop=loop) as session:
        feature = loop.run_until_complete(fetch_all(session, urls, loop))
        return feature

async def fetch_all(session, urls, loop):
    results = await asyncio.gather(*[loop.create_task(fetch(session, url)) for url in urls])
    return results


async def fetch(session, url):
    with async_timeout.timeout(10):
        async with session.get(url[0]) as response:
            newFeature = fmeobjects.FMEFeature()
            response_data = await response
            newFeature.setAttribute('response', response_data)
            newFeature.setAttribute('_xmin',url[1])
            newFeature.setAttribute('_xmax',url[2])
            newFeature.setAttribute('_ymin',url[3])
            newFeature.setAttribute('_ymax',url[4])
            return newFeature

我尝试进行以下更改:     导入fme     导入fmeobjects     导入异步     导入aiohttp     导入async_timeout     logger = fmeobjects.FMELogFile()

class FeatureProcessor(object):
    def __init__(self):
        pass
    def input(self, feature):
        urls_and_coords = zip(feature.getAttribute('_list{}._wms'),\
        feature.getAttribute('_list{}._xmin'),\
        feature.getAttribute('_list{}._ymin'),\
        feature.getAttribute('_list{}._xmax'),\
        feature.getAttribute('_list{}._ymax'))
        loop = asyncio.get_event_loop()
        result = loop.run_until_complete(main(loop, urls_and_coords))
        #feature.setAttribute('result',result)
        self.pyoutput(feature)

    def close(self):
       pass 

async def main(loop, urls):
    async with aiohttp.ClientSession(loop=loop) as session:
        return await fetch_all(session, urls, loop)


async def fetch_all(session, urls, loop):
    results = await asyncio.gather(*[loop.create_task(fetch(session, url)) for url in urls])
    return results


async def fetch(session, url):
    with async_timeout.timeout(10):
        async with session.get(url[0]) as response:
            #newFeature = fmeobjects.FMEFeature()
            response = await response
            #newFeature.setAttribute('response', response_data)
            #newFeature.setAttribute('_xmin',url[1])
            #newFeature.setAttribute('_xmax',url[2])
            #newFeature.setAttribute('_ymin',url[3])
            #newFeature.setAttribute('_ymax',url[4])
            return response, url[1], url[2], url[3], url[4]

但现在我最终遇到此错误:

Python Exception <TypeError>: object ClientResponse can't be used in 'await' 
expression
Traceback (most recent call last):
  File "<string>", line 20, in input
  File "asyncio\base_events.py", line 467, in run_until_complete
  File "<string>", line 29, in main
  File "<string>", line 33, in fetch_all
  File "<string>", line 41, in fetch
TypeError: object ClientResponse can't be used in 'await' expression

3 个答案:

答案 0 :(得分:2)

您将使用事件循环执行异步功能以完成操作:

newfeature = asyncio.get_event_loop().run_until_complete(main(urls_and_coords))

(此技术已在main内部使用。我不确定为什么,因为mainasync,所以您可以/应该在那里使用await fetch_all(...)。)< / p>

答案 1 :(得分:2)

@deceze答案可能是您在Python 3.6中可以做的最好的事情。 但是在Python 3.7中,您可以通过以下方式直接使用asyncio.run

newfeature = asyncio.run(main(urls))

它将正确创建,处理和关闭event_loop

答案 2 :(得分:1)

另一个有用的选择是syncer PyPI软件包:

from syncer import sync

@sync
async def print_data():
    print(await get_data())

print_data()  # Can be called synchronously