气流工人达不到平方

时间:2018-08-30 16:22:01

标签: celery amazon-sqs airflow worker

我正在运行气流工作人员服务。该服务无法连接到sqs

调度程序可以访问并写入队列

环境: 亚马逊Linux Python 3.54 气流1.10.1 芹菜4.1.1

代理很好;我已经在python 2.7和3.5相同的问题中实现了这一点

我已经为该区域设置了celery_transport_options 气流配置了celeryExecutor,SQS代理和Postgres数据库作为后端

部分日志

[2018-08-30 15:43:58,779: CRITICAL/MainProcess] Unrecoverable error: Exception('Request Empty body HTTP 599 Failed to connect to eu-west-1.queue.amazonaws.com port 443: Connection timed out (None)',)
Traceback (most recent call last):
 File "/usr/local/lib/python3.5/site-packages/celery/worker/worker.py", line 207, in start
 self.blueprint.start(self)
 File "/usr/local/lib/python3.5/site-packages/celery/bootsteps.py", line 119, in start
 step.start(parent)
 File "/usr/local/lib/python3.5/site-packages/celery/bootsteps.py", line 370, in start
 return self.obj.start()
 File "/usr/local/lib/python3.5/site-packages/celery/worker/consumer/consumer.py", line 316, in start
 blueprint.start(self)
 File "/usr/local/lib/python3.5/site-packages/celery/bootsteps.py", line 119, in start
 step.start(parent)
 File "/usr/local/lib/python3.5/site-packages/celery/worker/consumer/consumer.py", line 592, in start
 c.loop(*c.loop_args())
 File "/usr/local/lib/python3.5/site-packages/celery/worker/loops.py", line 91, in asynloop
 next(loop)
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/hub.py", line 354, in create_loop
 cb(*cbargs)
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/http/curl.py", line 114, in on_writable
 return self._on_event(fd, _pycurl.CSELECT_OUT)
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/http/curl.py", line 124, in _on_event
 self._process_pending_requests()
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/http/curl.py", line 132, in _process_pending_requests
 self._process(curl, errno, reason)
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/http/curl.py", line 178, in _process
 buffer=buffer, effective_url=effective_url, error=error,
 File "/usr/local/lib/python3.5/site-packages/vine/promises.py", line 150, in __call__
 svpending(*ca, **ck)
 File "/usr/local/lib/python3.5/site-packages/vine/promises.py", line 143, in __call__
 return self.throw()
 File "/usr/local/lib/python3.5/site-packages/vine/promises.py", line 140, in __call__
 retval = fun(*final_args, **final_kwargs)
 File "/usr/local/lib/python3.5/site-packages/vine/funtools.py", line 100, in _transback
 return callback(ret)
 File "/usr/local/lib/python3.5/site-packages/vine/promises.py", line 143, in __call__
 return self.throw()

File "/usr/local/lib/python3.5/site-packages/vine/promises.py", line 140, in __call__
 retval = fun(*final_args, **final_kwargs)
 File "/usr/local/lib/python3.5/site-packages/vine/funtools.py", line 98, in _transback
 callback.throw()
 File "/usr/local/lib/python3.5/site-packages/vine/funtools.py", line 96, in _transback
 ret = filter_(*args + (ret,), **kwargs)
 File "/usr/local/lib/python3.5/site-packages/kombu/asynchronous/aws/connection.py", line 233, in _on_list_ready
 raise self._for_status(response, response.read())
Exception: Request Empty body HTTP 599 Failed to connect to eu-west-1.queue.amazonaws.com port 443: Connection timed out (None)

0 个答案:

没有答案