Question

我正在尝试更改rq作业的超时但似乎没有任何效果。我有一些效果：

my_queue = Queue('my_task', connection=Redis())

job_args = (1, 2, 4)

my_queue.enqueue_call(
                    my_func,
                    args=job_args,
                    timeout=2700
            )

但我还是得到了

JobTimeoutException: Job exceeded maximum timeout value (180 seconds)

我非常绝望，我甚至尝试进入rq模块queue.py并将timeout的默认参数更改为2700和DEFAULT_TIMEOUT（在Queue类中定义的变量，其中包含enqueue_call方法）。我错过了什么，或者有人知道这个问题吗？谢谢！

Answer 1

我们可以通过在Queue初始化时设置超时来解决这个问题。

from rq import Worker, Queue, Connection
q = Queue(default_timeout=3600)

希望这会解决您的疑问。

Answer 2

使用

my_queue = Queue('my_task', connection=Redis())
job_args = [1, 2, 4]

my_queue.enqueue_call(
                f=my_func,
                job_timeout=2700,
                args=job_args
        )

超时不是正确的参数名称。在queue.py

中检查“ parse_args”函数是否包含所有其他参数名称

Answer 3

enqueue_call中的超时参数没有问题。刚刚用这个例子测试了它。

function.py

from time import sleep
def test(a, b, c):
    sleep(a)
    print str(b+c)

driver.py

from redis import Redis
from rq import Queue
from function import test

q = Queue('abc', connection=Redis())

q.enqueue_call(test, args=(300, 2, 3), timeout=200)
q.enqueue_call(test, args=(100, 2, 3), timeout=200)

结果：

13:08:11 abc: test.test(100, 2, 3) (4b4e96e5-af30-4175-ab94-ceaf9187e581)
5
13:08:13 abc: test.test(300, 2, 3) (04605c34-d039-42ad-954e-7f445f0f8bc9)
13:11:17 JobTimeoutException: Job exceeded maximum timeout value (200 seconds)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/rq/worker.py", line 568, in perform_job
    rv = job.perform()
  File "/usr/local/lib/python2.7/dist-packages/rq/job.py", line 495, in perform
    self._result = self.func(*self.args, **self.kwargs)
  File "./test.py", line 4, in test
    sleep(a)
  File "/usr/local/lib/python2.7/dist-packages/rq/timeouts.py", line 51, in handle_death_penalty
    'value ({0} seconds)'.format(self._timeout))
JobTimeoutException: Job exceeded maximum timeout value (200 seconds)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/rq/worker.py", line 568, in perform_job
    rv = job.perform()
  File "/usr/local/lib/python2.7/dist-packages/rq/job.py", line 495, in perform
    self._result = self.func(*self.args, **self.kwargs)
  File "./test.py", line 4, in test
    sleep(a)
  File "/usr/local/lib/python2.7/dist-packages/rq/timeouts.py", line 51, in handle_death_penalty
    'value ({0} seconds)'.format(self._timeout))
JobTimeoutException: Job exceeded maximum timeout value (200 seconds)

如果您使用管理员等工具来管理rq worker，请尝试重新启动该服务。

在enqueue调用中的rq timeout param不起作用，给出JobTimeoutException

3 个答案: