我有两个简单的定期芹菜任务,它们在夜间运行,一个在凌晨2点,另一个在凌晨3点,以及从djcelery_periodictask
表上的死锁异常抛出的时间之后我不太明白。似乎有一个任务尝试更新djcelery_periodictask
,而其他任务仍然持有共享锁:
deadlock detected Detail: Process 32353 waits for ShareLock on transaction 39280165; blocked by process 32306. Process 32306 waits for ShareLock on transaction 39280166; blocked by process 32353.
Process 32353:
UPDATE "djcelery_periodictask" SET "name" = 'app.tasks.task1', "task" = 'app.tasks.task1', "interval_id" = NULL, "crontab_id" = 4, "args" = '[]', "kwargs" = '{}', "queue" = NULL, "exchange" = NULL, "routing_key" = NULL, "expires" = NULL, "enabled" = true, "last_run_at" = '2015-02-10 03:00:00.001297+01:00', "total_run_count" = 117, "date_changed" = '2015-02-10 02:00:00.010033+00:00', "description" = '' WHERE "djcelery_periodictask"."id" = 4
Process 32306:
UPDATE "djcelery_periodictask" SET "name" = 'app.tasks.task2', "task" = 'app.tasks.task2', "interval_id" = NULL, "crontab_id" = 6, "args" = '[]', "kwargs" = '{}', "queue" = NULL, "exchange" = NULL, "routing_key" = NULL, "expires" = NULL, "enabled" = true, "last_run_at" = '2015-02-10 02:00:00.014189+01:00', "total_run_count" = 63, "date_changed" = '2015-02-10 02:00:00.015097+00:00', "description" = '' WHERE "djcelery_periodictask"."id" = 6
Hint: See server log for query details. Query:
UPDATE "djcelery_periodictask" SET "name" = 'app.tasks.task2', "task" = 'appt.tasks.task2', "interval_id" = NULL, "crontab_id" = 4, "args" = '[]', "kwargs" = '{}', "queue" = NULL, "exchange" = NULL, "routing_key" = NULL, "expires" = NULL, "enabled" = true, "last_run_at"
如果两个只包含几行的表的简单更新怎么会出现死锁?
答案 0 :(得分:0)
我的问题是我的所有工作人员都使用-B
参数启动,这使得每个工作人员都处于定期任务调度程序中:
-B, --beat Also run the celery beat periodic task scheduler.
Please note that there must only be one instance of
this service.
因此,计划任务多次启动,同时全部启动,在尝试更新djcelery_periodictask
表时会造成死锁。