Python Flask与芹菜在应用程序上下文之外

Question

我正在使用python Flask构建一个网站。一切都很顺利，现在我正在努力实施芹菜。

在我尝试使用来自芹菜的烧瓶邮件发送电子邮件之前，情况也很顺利。现在我正在“在应用程序上下文之外工作”错误。

完全追溯是

  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/celery/task/trace.py", line 228, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/celery/task/trace.py", line 415, in __protected_call__
    return self.run(*args, **kwargs)
  File "/home/ryan/www/CG-Website/src/util/mail.py", line 28, in send_forgot_email
    msg = Message("Recover your Crusade Gaming Account")
  File "/usr/lib/python2.7/site-packages/flask_mail.py", line 178, in __init__
    sender = current_app.config.get("DEFAULT_MAIL_SENDER")
  File "/usr/lib/python2.7/site-packages/werkzeug/local.py", line 336, in __getattr__
    return getattr(self._get_current_object(), name)
  File "/usr/lib/python2.7/site-packages/werkzeug/local.py", line 295, in _get_current_object
    return self.__local()
  File "/usr/lib/python2.7/site-packages/flask/globals.py", line 26, in _find_app
    raise RuntimeError('working outside of application context')
RuntimeError: working outside of application context

这是我的邮件功能：

@celery.task
def send_forgot_email(email, ref):
    global mail
    msg = Message("Recover your Crusade Gaming Account")
    msg.recipients = [email]
    msg.sender = "Crusade Gaming stuff@cg.com"
    msg.html = \
        """
        Hello Person,<br/>

        You have requested your password be reset. <a href="{0}" >Click here recover your account</a> or copy and paste this link in to your browser: {0} <br />

        If you did not request that your password be reset, please ignore this.
        """.format(url_for('account.forgot', ref=ref, _external=True))
    mail.send(msg)

这是我的芹菜文件：

from __future__ import absolute_import

from celery import Celery

celery = Celery('src.tasks',
                broker='amqp://',
                include=['src.util.mail'])


if __name__ == "__main__":
    celery.start()

Answer 1

Flask-mail需要Flask应用程序上下文才能正常工作。在芹菜方面实例化app对象并使用app.app_context，如下所示：

with app.app_context():
    celery.start()

Answer 2

这是一个解决方案，它适用于烧瓶应用工厂模式，并且还可以使用上下文创建芹菜任务，而无需使用app.app_context()。在避免循环导入的同时获取该应用程序真的很棘手，但这解决了它。这是芹菜4.2，这是在撰写本文时的最新版本。

结构：

repo_name/
    manage.py
    base/
    base/__init__.py
    base/app.py
    base/runcelery.py
    base/celeryconfig.py
    base/utility/celery_util.py
    base/tasks/workers.py

因此base是此示例中的主要应用程序包。在base/__init__.py我们创建芹菜实例如下：

from celery import Celery
celery = Celery('base', config_source='base.celeryconfig')

base/app.py文件包含烧瓶应用工厂create_app并记下它包含的init_celery(app, celery)：

from base import celery
from base.utility.celery_util import init_celery

def create_app(config_obj):
    """An application factory, as explained here:
    http://flask.pocoo.org/docs/patterns/appfactories/.
    :param config_object: The configuration object to use.
    """
    app = Flask('base')
    app.config.from_object(config_obj)
    init_celery(app, celery=celery)
    register_extensions(app)
    register_blueprints(app)
    register_errorhandlers(app)
    register_app_context_processors(app)
    return app

转到base/runcelery.py内容：

from flask.helpers import get_debug_flag
from base.settings import DevConfig, ProdConfig
from base import celery
from base.app import create_app
from base.utility.celery_util import init_celery
CONFIG = DevConfig if get_debug_flag() else ProdConfig
app = create_app(CONFIG)
init_celery(app, celery)

接下来，base/celeryconfig.py文件（作为示例）：

# -*- coding: utf-8 -*-
"""
Configure Celery. See the configuration guide at ->
http://docs.celeryproject.org/en/master/userguide/configuration.html#configuration
"""

## Broker settings.
broker_url = 'pyamqp://guest:guest@localhost:5672//'
broker_heartbeat=0

# List of modules to import when the Celery worker starts.
imports = ('base.tasks.workers',)

## Using the database to store task state and results.
result_backend = 'rpc'
#result_persistent = False

accept_content = ['json', 'application/text']

result_serializer = 'json'
timezone = "UTC"

# define periodic tasks / cron here
# beat_schedule = {
#    'add-every-10-seconds': {
#        'task': 'workers.add_together',
#        'schedule': 10.0,
#        'args': (16, 16)
#    },
# }

现在在base/utility/celery_util.py文件中定义init_celery：

# -*- coding: utf-8 -*-

def init_celery(app, celery):
    """Add flask app context to celery.Task"""
    TaskBase = celery.Task
    class ContextTask(TaskBase):
        abstract = True
        def __call__(self, *args, **kwargs):
            with app.app_context():
                return TaskBase.__call__(self, *args, **kwargs)
    celery.Task = ContextTask

base/tasks/workers.py中的工人：

from base import celery as celery_app
from flask_security.utils import config_value, send_mail
from base.bp.users.models.user_models import User
from base.extensions import mail # this is the flask-mail

@celery_app.task
def send_async_email(msg):
    """Background task to send an email with Flask-mail."""
    #with app.app_context():
    mail.send(msg)

@celery_app.task
def send_welcome_email(email, user_id, confirmation_link):
    """Background task to send a welcome email with flask-security's mail.
    You don't need to use with app.app_context() here. Task has context.
    """
    user = User.query.filter_by(id=user_id).first()
    print(f'sending user {user} a welcome email')
    send_mail(config_value('EMAIL_SUBJECT_REGISTER'),
              email,
              'welcome', user=user,
              confirmation_link=confirmation_link) 

然后，您需要在repo_name文件夹中的两个不同的cmd提示中启动芹菜节拍和芹菜工作者。

在一个cmd提示符下执行celery -A base.runcelery:celery beat和另一个celery -A base.runcelery:celery worker。

然后，执行需要烧瓶上下文的任务。应该工作。

Answer 3

在您的mail.py文件中，导入“app”和“mail”对象。然后，使用请求上下文。做这样的事情：

from whateverpackagename import app
from whateverpackagename import mail

@celery.task
def send_forgot_email(email, ref):
    with app.test_request_context():
        msg = Message("Recover your Crusade Gaming Account")
        msg.recipients = [email]
        msg.sender = "Crusade Gaming stuff@cg.com"
        msg.html = \
        """
        Hello Person,<br/>
        You have requested your password be reset. <a href="{0}" >Click here recover your account</a> or copy and paste this link in to your browser: {0} <br />
        If you did not request that your password be reset, please ignore this.
        """.format(url_for('account.forgot', ref=ref, _external=True))

        mail.send(msg)

Answer 4

我没有任何积分，所以我无法提升@ codegeek的答案，所以我决定写自己的，因为我搜索这样的问题得到了这个问题的帮助/回答：我在尝试解决python / flask / celery场景中的类似问题时取得了一些成功。即使您的错误来自尝试使用mail，而我的错误是在芹菜任务中尝试使用url_for，我怀疑这两个问题与同一问题有关，并且您可能会遇到错误如果您曾尝试在url_for之前使用{。}}，请使用mail。

在芹菜任务中没有应用程序的上下文（即使包括import app from my_app_module之后），我也遇到了错误。您需要在应用程序的上下文中执行mail操作：

from module_containing_my_app_and_mail import app, mail    # Flask app, Flask mail
from flask.ext.mail import Message    # Message class

@celery.task
def send_forgot_email(email, ref):
    with app.app_context():    # This is the important bit!
        msg = Message("Recover your Crusade Gaming Account")
        msg.recipients = [email]
        msg.sender = "Crusade Gaming stuff@cg.com"
        msg.html = \
        """
        Hello Person,<br/>
        You have requested your password be reset. <a href="{0}" >Click here recover your account</a> or copy and paste this link in to your browser: {0} <br />
        If you did not request that your password be reset, please ignore this.
        """.format(url_for('account.forgot', ref=ref, _external=True))

        mail.send(msg)

如果有人有兴趣，可以找到我在芹菜任务中使用url_for问题的解决方案here

Answer 5

在不使用app.app_context()的情况下，只需在注册蓝图之前配置芹菜，如下所示：

celery = Celery('myapp', broker='redis://localhost:6379/0', backend='redis://localhost:6379/0')

从希望使用celery的蓝图中，调用已创建的celery实例来创建celery任务。

它将按预期工作。