Pika blocking_connection.py随机超时连接到RabbitMQ

时间:2013-04-23 07:22:17

标签: python rabbitmq rpc pika python-pika

我在机器上运行了一个兔子mq

  • 客户端和rabbitMQ都在同一个网络上运行
  • rabbitMQ有很多客户
  • 我可以从rabbitMQ ping客户端并返回
  • 在机器之间测量的最长延迟为12.1 ms
  • 网络详细信息:标准交换机网络(在单个物理机上运行的虚拟机网络 - 使用vmware VC)

初始化RPC连接时获取随机超时

  

/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/adapters/blocking_connection.py

问题是超时不一致并且不时发生。

手动测试此问题并在同一台机器上运行blocking_connection.py 1000次失败时,不会产生超时。

这是我失败时得到的错误:

2013-04-23 08:24:23,396 runtest-trigger.24397 24397 DEBUG      producer_rabbit initiate_rpc_connection Connecting to RabbitMQ RPC queue rpcqueue_java on host: auto-db1
2013-04-23 08:24:25,350 runtest-trigger.24397 24397 ERROR      testrunner go   Run 1354: cought exception: timed out
Traceback (most recent call last):
  File "/testrunner.py", line 193, in go
    self.set_runparams(jobid)
  File "/testrunner.py", line 483, in set_runparams
    self.runparams.producers_testrun = self.initialize_producers_testrun(self.runparams)
  File "/basehandler.py", line 114, in initialize_producers_testrun
    producer.set_testcase_checkout()
  File "/baseproducer.py", line 73, in set_testcase_checkout
    self.checkout_handler = pm_checkout.get_producer(self.testcasecheckout)
  File "/producer_manager.py", line 101, in get_producer
    producer = self.load_producer(plugin_dir, producer_name)
  File "/producer_manager.py", line 20, in load_producer
    producer = getattr(producer_module, 'Producer')(producer_name, self.runparams)
  File "/producer_rabbit.py", line 13, in __init__
    self.initiate_rpc_connection()
  File "/producer_rabbit.py", line 67, in initiate_rpc_connection
    self.connection = pika.BlockingConnection(pika.ConnectionParameters( host=self.conf.rpc_proxy))
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/adapters/blocking_connection.py", line 32, in __init__
    BaseConnection.__init__(self, parameters, None, reconnection_strategy)
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/adapters/base_connection.py", line 50, in __init__
    reconnection_strategy)
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/connection.py", line 170, in __init__
    self._connect()
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/connection.py", line 228, in _connect
    self.parameters.port or  spec.PORT)
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/adapters/blocking_connection.py", line 44, in _adapter_connect
    self._handle_read()
  File "/usr/lib/python2.6/site-packages/pika-0.9.5-py2.6.egg/pika/adapters/base_connection.py", line 151, in _handle_read
    data = self.socket.recv(self._suggested_buffer_size)
timeout: timed out

请协助

2 个答案:

答案 0 :(得分:1)

我有类似的问题。如果一切看起来都很好,那么你很可能会有一些错过配置,例如:坏约束力。如果未配置,那么您将获得timeout,因为脚本无法到达其认为需要的位置,因此在这种情况下错误可能会失败。

对于我的问题,我特意遇到了我的rabbitmq.config文件和我的绑定问题,并且必须在我显示的命令行示例中使用我的python解决方案:RabbitMQ creating queues and bindings from a command line。一旦更新和配置正确,一切正常。希望这能让你朝着正确的方向前进。

答案 1 :(得分:1)

Pika在连接不同的主机时提供了一些超时问题。解决方法是在连接参数中传递socket_timeout参数.Pika应该升级到> = 0.9.14

credentials = pika.PlainCredentials(RABBITMQ_USER, RABBITMQ_PASS)
connection = pika.BlockingConnection(pika.ConnectionParameters(
    credentials=credentials,
        host=RABBITMQ_HOST,
         socket_timeout=300))
channel = connection.channel()