Question

我正在运行以下代码以使异步＆＃34; get＆＃34;要求。 CustomSession类用于添加对每个请求进行计时的支持。

如果发生异常或请求运行正常，我希望能够访问附加到test_id列表的futures以及要请求的URL。换句话说，当请求运行或抛出异常时，我想找到与test_id的调用关联的session.get。

from datetime import datetime
from requests_futures.sessions import FuturesSession

class CustomSession(FuturesSession):

    def __init__(self, *args, **kwargs):
        super(CustomSession, self).__init__(*args, **kwargs)
        self.timing = {}

    def request(self, method, url, *args, **kwargs):
        background_callback = kwargs.pop('background_callback', None)
        test_id = kwargs.pop('test_id', None)

        # start counting
        self.timing[test_id] = datetime.now()

        def time_it(sess, resp):
            # here if you want to time the server stuff only
            self.timing[test_id] = datetime.now() - self.timing[test_id]
            if background_callback:
                background_callback(sess, resp)
            # here if you want to include any time in the callback

        return super(CustomSession, self).request(method, url, *args,
                                                  background_callback=time_it,
                                                  **kwargs)


session = CustomSession()

futures = []
for url in ('http://httpbin.org/get?key=val',
            'http://httpasdfasfsadfasdfasdfbin.org/get?key2=val2'):

    futures.append(session.get(url, test_id=1))
for future in futures:
    try:
        r = future.result()
        print(r.status_code)
    except Exception as e:
        print(e)

Answer 1

我为future对象的result（）函数创建了一个装饰器：

def mark_exception(fn, id, url):
    def new_fn(*args, **kwargs):
        try:
            return fn(*args, **kwargs)
        except:
            raise Exception("test id %d with url %s threw exception" % (id, url))
    return new_fn

并在CustomSession.request（）函数的末尾应用它，替换原始的return语句：

future =  super(CustomSession, self).request(method, url, *args,
                                          background_callback=time_it,
                                          **kwargs)
future.result = mark_exception(future.result, test_id, url)
return future

输出：

200
test id 1 with url http://httpasdfasfsadfasdfasdfbin.org/get?key2=val2 threw exception

我希望这会有所帮助。

编辑：

如果您希望获得每个未来的测试ID，可以通过以下两种方式进行操作：

futures = []
for url in ('http://httpbin.org/get?key=val',
            'http://httpasdfasfsadfasdfasdfbin.org/get?key2=val2'):
    tid = 1
    future = session.get(url, test_id=tid)
    # option 1: set test_id as an attrib of the future object
    future.test_id = tid
    # option 2: put test_id and future object in a tuple before appending to the list
    futures.append((tid, future))
for tid, future in futures:
    try:
        r = future.result()
        print("tracked test_id is %d" % tid) #option 2
        print("status for test_id %d is %d" % (future.test_id, r.status_code)) #option 1
    except Exception as e:
        print(e)

将自定义数据传递给request_futures中的异常

1 个答案: