Python,流请求期间的Catch超时

时间:2014-01-20 13:31:31

标签: python python-requests urllib3

我正在使用请求库读取XML事件,如下面的代码所示。请求启动后如何引发连接丢失错误?服务器正在模拟HTTP推/长轮询 - > http://en.wikipedia.org/wiki/Push_technology#Long_polling并且默认不会结束。 如果10分钟后没有新消息,则应退出while循环。

import requests
from time import time


if __name__ == '__main__':
    #: Set a default content-length
    content_length = 512
    try:
        requests_stream = requests.get('http://agent.mtconnect.org:80/sample?interval=0', stream=True, timeout=2)
        while True:
            start_time = time()
            #: Read three lines to determine the content-length         
            for line in requests_stream.iter_lines(3, decode_unicode=None):
                if line.startswith('Content-length'):
                    content_length = int(''.join(x for x in line if x.isdigit()))
                    #: pause the generator
                    break

            #: Continue the generator and read the exact amount of the body.        
            for xml in requests_stream.iter_content(content_length):
                print "Received XML document with content length of %s in %s seconds" % (len(xml), time() - start_time)
                break

    except requests.exceptions.RequestException as e:
        print('error: ', e)

可以通过命令行使用curl测试服务器推送:

curl http://agent.mtconnect.org:80/sample\?interval\=0

1 个答案:

答案 0 :(得分:0)

这可能不是最好的方法,但您可以使用多处理在单独的进程中运行请求。 这样的事情应该有效:

import multiprocessing
import requests
import time

class RequestClient(multiprocessing.Process):
    def run(self):
        # Write all your code to process the requests here
        content_length = 512
        try:
            requests_stream = requests.get('http://agent.mtconnect.org:80/sample?interval=0', stream=True, timeout=2)

            start_time = time.time()
            for line in requests_stream.iter_lines(3, decode_unicode=None):
                if line.startswith('Content-length'):
                    content_length = int(''.join(x for x in line if x.isdigit()))
                    break

            for xml in requests_stream.iter_content(content_length):
                print "Received XML document with content length of %s in %s seconds" % (len(xml), time.time() - start_time) 
                break
        except requests.exceptions.RequestException as e:
            print('error: ', e)


While True:
    childProcess = RequestClient()
    childProcess.start()

    # Wait for 10mins
    start_time = time.time()
    while time.time() - start_time <= 600:
        # Check if the process is still active
        if not childProcess.is_alive():
            # Request completed
            break
        time.sleep(5)    # Give the system some breathing time

    # Check if the process is still active after 10mins.
    if childProcess.is_alive():
        # Shutdown the process
        childProcess.terminate()
        raise RuntimeError("Connection Timed-out")

不是您问题的完美代码,但您明白了。