dask作业无限期地挂起

时间:2018-01-15 06:49:26

标签: dask dask-distributed

我使用dask-client submit api运行多个并发dask作业。它多次遇到过这个问题。

特定工作人员的线程转储显示以下信息。

有人可以指导我解决这个问题。

ts_data = dask_df[key].values.compute()
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/dask/base.py", line 135, in compute
    (result,) = compute(self, traverse=False, **kwargs)
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/dask/base.py", line 333, in compute
    results = get(dsk, keys, **kwargs)
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 1999, in get
    results = self.gather(packed, asynchronous=asynchronous)
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 1437, in gather
    asynchronous=asynchronous)
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 592, in sync
    return sync(self.loop, func, *args, **kwargs)
  File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/utils.py", line 252, in sync
    e.wait(1000000)
  File "/agent/miniconda3/envs/py361/lib/python3.6/threading.py", line 551, in wait
    signaled = self._cond.wait(timeout)
  File "/agent/miniconda3/envs/py361/lib/python3.6/threading.py", line 299, in wait
    gotit = waiter.acquire(True, timeout)

0 个答案:

没有答案