气流导入错误断线:服务器意外关闭连接

时间:2019-09-09 08:55:32

标签: sqlalchemy airflow

突然,气流Web服务器开始在UI上显示如下警告,

Broken DAG: [<dag_path>] server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request.

我在后端使用MySQL,服务器运行正常,没有任何问题。

试图检查元数据,发现错误数量不断变化,

mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
|       24 |
+----------+
1 row in set (0.00 sec)

mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
|        3 |
+----------+
1 row in set (0.00 sec)

mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
|        0 |
+----------+
1 row in set (0.00 sec)

这是airflow.cfg中的sqlalchemy配置

sql_alchemy_conn =mysql://<user>:<pass>@localhost/airflow
sql_alchemy_pool_enabled = True
sql_alchemy_pool_size = 5
sql_alchemy_pool_recycle = 1800
sql_alchemy_reconnect_timeout = 300

我正在使用气流版本1.10.1

0 个答案:

没有答案