突然,气流Web服务器开始在UI上显示如下警告,
Broken DAG: [<dag_path>] server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request.
我在后端使用MySQL,服务器运行正常,没有任何问题。
试图检查元数据,发现错误数量不断变化,
mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
| 24 |
+----------+
1 row in set (0.00 sec)
mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
| 3 |
+----------+
1 row in set (0.00 sec)
mysql> select count(*) from import_error;
+----------+
| count(*) |
+----------+
| 0 |
+----------+
1 row in set (0.00 sec)
这是airflow.cfg中的sqlalchemy配置
sql_alchemy_conn =mysql://<user>:<pass>@localhost/airflow
sql_alchemy_pool_enabled = True
sql_alchemy_pool_size = 5
sql_alchemy_pool_recycle = 1800
sql_alchemy_reconnect_timeout = 300
我正在使用气流版本1.10.1