气流KubernetesPodOperator AirflowException('吊舱启动失败:{error}'。format(error = ex))

时间:2020-04-14 23:19:41

标签: kubernetes airflow ubuntu-18.04 microk8s

我正在运行带有通过microk8s导入的自定义泊坞窗映像的KubernetesPodOperator。在气流中运行DAG时,我会看到以下日志,直到收到超时消息AirflowException('Pod Launching failed: {error}'.format(error=ex))

[2020-04-14 23:06:39,875] {logging_mixin.py:95} INFO - [[34m2020-04-14 23:06:39,875[0m] {[34mpod_launcher.py:[0m141} INFO[0m - Event: [1mk8s-pod-ml-3a541375[0m had an event of type [1mPending[0m[0m

搜索我在ubuntus终端上运行microk8s kubectl get pods的问题并得到: enter image description here

如您所见,在日志中,窗格的名称几乎完全相同(除了开头的1m除外),但是状态为ErrImageNeverPull。除了this上面写着“ KubernetesPodOperator的默认超时为120秒,这可能导致超时,然后再下载较大的图像。” em>'我将默认超时时间更改为600秒,但是没有用。

1 个答案:

答案 0 :(得分:0)

问题

Microk8s无法访问docker。我通过运行microk8s.inspect并获得

来了解它
WARNING:  Docker is installed. 
File "/etc/docker/daemon.json" does not exist. 
You should create it and add the following lines: 
{
    "insecure-registries" : ["localhost:32000"] 
}

and then restart docker with: sudo systemctl restart docker
Building the report tarball
  Report tarball is at /var/snap/microk8s/1320/inspection-report-20200415_141500.tar.gz

警告后,气流设法将图像部署在吊舱中。