Question

我有一个与Redis一起使用的Celery任务：

@app.task(bind=True, name='task_a', max_retries=4, soft_time_limit_exception=300)
def task_a(self, a, b):
    try:
        # some code here
    except Exception as e:
        raise self.retry(exc=e, countdown=exponential_backoff(self))


def exponential_backoff(task_self):
    minutes = task_self.default_retry_delay / 60
    rand = random.uniform(minutes, minutes * 1.5)
    return int(rand ** task_self.request.retries) * 60

我有以下问题：

如果Redis不在工作或芹菜工作者停止/失败，则代码是“等待”，而不是继续执行代码。

如果我将try except block放在任务内，或者将任务放在try except内，它什么也没接住，我得到一个ConnectionAbortedError。

在这种情况下，我想要的是捕获特定错误并执行其他操作，或者忽略而不调用重试。

@Pavel Minenkov的答案建议使用sentry.io，但问题是我不知道该怎么抓。

请参阅追溯：

----------------------------------------
Exception happened during processing of request from ('127.0.0.1', 49301)
Traceback (most recent call last):
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 138, in run
    self.finish_response()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 180, in finish_response
    self.write(data)
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 274, in write
    self.send_headers()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 332, in send_headers
    self.send_preamble()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 255, in send_preamble
    ('Date: %s\r\n' % format_date_time(time.time())).encode('iso-8859-1')
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 453, in _write
    result = self.stdout.write(data)
  File "D:\DevEnv\Python\lib\socketserver.py", line 796, in write
    self._sock.sendall(b)
ConnectionAbortedError: [WinError 10053] An established connection was aborted by the software in your host machine

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 141, in run
    self.handle_error()
  File "D:\DevEnv\PythonVENV\DjangoDev\lib\site-packages\django\core\servers\basehttp.py", line 86, in handle_error
    super().handle_error()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 368, in handle_error
    self.finish_response()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 180, in finish_response
    self.write(data)
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 274, in write
    self.send_headers()
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 331, in send_headers
    if not self.origin_server or self.client_is_modern():
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 344, in client_is_modern
    return self.environ['SERVER_PROTOCOL'].upper() != 'HTTP/0.9'
TypeError: 'NoneType' object is not subscriptable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\DevEnv\Python\lib\socketserver.py", line 647, in process_request_thread
    self.finish_request(request, client_address)
  File "D:\DevEnv\Python\lib\socketserver.py", line 357, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "D:\DevEnv\Python\lib\socketserver.py", line 717, in __init__
    self.handle()
  File "D:\DevEnv\PythonVENV\DjangoDev\lib\site-packages\django\core\servers\basehttp.py", line 154, in handle
    handler.run(self.server.get_app())
  File "D:\DevEnv\Python\lib\wsgiref\handlers.py", line 144, in run
    self.close()
  File "D:\DevEnv\Python\lib\wsgiref\simple_server.py", line 35, in close
    self.status.split(' ',1)[0], self.bytes_sent
AttributeError: 'NoneType' object has no attribute 'split'

Answer 1

首先实施监控系统。我喜欢Sentry：https://sentry.io/welcome/ 1位用户免费使用

from raven import Client
...
@app.task(bind=True, name='task_a', max_retries=4, soft_time_limit_exception=300)
def task_a(self, a, b):
    sentry = Client(dsn=<your>)
    with sentry.capture_exceptions():
        # some code here

然后，您将能够发现引发了哪些异常，然后您可以解决该问题

ConnectionAbortedError-如果Celery停止/失败或未启动Redis。如何捕获/排除此错误/

1 个答案: