尝试运行django-celery worker进程时生成的ImportError

时间:2013-07-30 11:06:32

标签: django celery django-celery

我正在尝试将django-celery集成到现有网站中,我遇到了一个我似乎无法修复的错误。

对于上下文,我浏览了Django first steps,测试项目成功,即一切正常。

现在,在我现有的项目中,我无法从命令行运行芹菜工作者:

manage.py celery worker --loglevel=info --settings=myproject.settings.dev_settings

当我运行时,我得到以下堆栈跟踪和错误:

Traceback (most recent call last):
  File "C:\sites\corecrm\manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "C:\Python27\lib\site-packages\django\core\management\__init__.py", line 453, in execute_from_command_line
    utility.execute()
  File "C:\Python27\lib\site-packages\django\core\management\__init__.py", line 392, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "C:\Python27\lib\site-packages\djcelery\management\commands\celery.py", line 22, in run_from_argv
    ['%s %s' % (argv[0], argv[1])] + argv[2:],
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 901, in execute_from_commandline
    super(CeleryCommand, self).execute_from_commandline(argv)))
  File "C:\Python27\lib\site-packages\celery\bin\base.py", line 187, in execute_from_commandline
    return self.handle_argv(prog_name, argv[1:])
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 893, in handle_argv
    return self.execute(command, argv)
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 868, in execute
    return cls(app=self.app).run_from_argv(self.prog_name, argv)
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 148, in run_from_argv
    return self(*args, **options)
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 118, in __call__
    ret = self.run(*args, **kwargs)
  File "C:\Python27\lib\site-packages\celery\bin\celery.py", line 220, in run
    return self.target.run(*args, **kwargs)
  File "C:\Python27\lib\site-packages\celery\bin\celeryd.py", line 153, in run
    return self.app.Worker(**kwargs).run()
  File "C:\Python27\lib\site-packages\celery\apps\worker.py", line 162, in run
    self.app.loader.init_worker()
  File "C:\Python27\lib\site-packages\celery\loaders\base.py", line 130, in init_worker
    self.import_default_modules()
  File "C:\Python27\lib\site-packages\djcelery\loaders.py", line 138, in import_default_modules
    self.autodiscover()
  File "C:\Python27\lib\site-packages\djcelery\loaders.py", line 141, in autodiscover
    self.task_modules.update(mod.__name__ for mod in autodiscover() or ())
  File "C:\Python27\lib\site-packages\djcelery\loaders.py", line 176, in autodiscover
    for app in settings.INSTALLED_APPS])
  File "C:\Python27\lib\site-packages\djcelery\loaders.py", line 195, in find_related_module
    return importlib.import_module('%s.%s' % (app, related_name))
  File "C:\Python27\lib\importlib\__init__.py", line 37, in import_module
    __import__(name)
  File "C:\sites\corecrm\people\tasks.py", line 15, in <module>
    from people.models import Customer, CustomerCsvFile, CustomerToTag, get_customer_from_csv_row
  File "C:\sites\corecrm\people\models.py", line 163, in <module>
    UserProfile._meta.get_field_by_name('username')[0]._max_length = 75
  File "C:\Python27\lib\site-packages\django\db\models\options.py", line 351, in get_field_by_name
    cache = self.init_name_map()
  File "C:\Python27\lib\site-packages\django\db\models\options.py", line 380, in init_name_map
    for f, model in self.get_all_related_m2m_objects_with_model():
  File "C:\Python27\lib\site-packages\django\db\models\options.py", line 469, in get_all_related_m2m_objects_with_model
    cache = self._fill_related_many_to_many_cache()
  File "C:\Python27\lib\site-packages\django\db\models\options.py", line 483, in _fill_related_many_to_many_cache
    for klass in get_models(only_installed=False):
  File "C:\Python27\lib\site-packages\django\db\models\loading.py", line 197, in get_models
    self._populate()
  File "C:\Python27\lib\site-packages\django\db\models\loading.py", line 75, in _populate
    self.load_app(app_name)
  File "C:\Python27\lib\site-packages\django\db\models\loading.py", line 96, in load_app
    models = import_module('.models', app_name)
  File "C:\Python27\lib\site-packages\django\utils\importlib.py", line 35, in import_module
    __import__(name)
  File "C:\sites\corecrm\booking\models.py", line 17, in <module>
    from people.models import Customer, UserProfile
ImportError: cannot import name Customer

要尝试找出预订/ models.py脚本在人们看到的内容,我在开始时添加了以下内容:

import people
print 'path: %s' % people.__path__
for item in dir(people):
    print item

这给了我以下输出:

path: ['C:\\sites\\corecrm\\people']
__builtins__
__doc__
__file__
__name__
__package__
__path__
path: ['C:\\sites\\corecrm\\people']
__builtins__
__doc__
__file__
__name__
__package__
__path__

然而,当我运行manage.py shell --settings=myproject.settings.dev_settings时,我得到以下输出:

path: ['C:\\sites\\corecrm\\people']
__builtins__
__doc__
__file__
__name__
__package__
__path__
path: ['C:\\sites\\corecrm\\people']
__builtins__
__doc__
__file__
__name__
__package__
__path__
models

正如您所看到的,models模块在​​shell命令的第二个列表的末尾可用(我已经确认除了芹菜之外的manage.py命令也是如此)。当我运行celery命令时,如何确保模块在同一点可用?

编辑:我现在也在Ubuntu VM上设置了这个项目,当我尝试运行worker manage命令时,我遇到了同样的错误。有任何想法吗?任何人吗?

另一个编辑:我在http://pastebin.com/fTVVBtB4

粘贴了预订/ models.py和people / models.py的代码

1 个答案:

答案 0 :(得分:1)

我很确定这一行是你的问题:

File "C:\sites\corecrm\people\models.py", line 163, in <module>
    UserProfile._meta.get_field_by_name('username')[0]._max_length = 75

当您仍忙于从people.models导入时,此行(特别是get_field_by_name)强制Django评估模型并设置该模型与其相关模型之间的所有关系。反过来,这会强制在Customer中导入people.models,而您仍在忙于导入该确切模型。这就是ImportError的结果。

对于工作解决方案,您需要发布models.py.

为什么这个错误只发生在芹菜上?我不能在没有更多信息的情况下肯定地说,但我最好的猜测是Celery处理导入的所有内容略有不同(Django可能不会导入CustomerCustomerCsvFileCustomerToTag和{一次性{1}}并且这暴露了代码中的错误。

EDIT /溶液:
我会删除这一行:

get_customer_from_csv_row

将其移至实例级别,转移到UserProfile._meta.get_field_by_name('username')[0]._max_length = 75 方法:

__init__

如果问题的原因确实是我认为的,那么这将修复循环导入,同时提供相同的功能。如果max_length功能以某种方式被破坏(很可能是因为在内部将一个max_length验证器添加到CharField并且_max_length更改得太晚了)我会覆盖init方法中的完整class UserProfile(AbstractUser): def __init__(self, *args, **kwargs): self._meta.get_field_by_name('username')[0]._max_length = 75 super(UserProfile, self).__init__(*args, **kwargs) 字段:

username