气流版本:1.10.5
气流突然停止运行,我正在使用 LocalExecutor ,我不知道为什么它停止运行, 我在airflow / dags目录中大约有50个文件。 其中一些处于暂停状态,但过去两个月以来一直在那里。
# The number of task instances allowed to run concurrently by the scheduler
dag_concurrency = 60
# Are DAGs paused by default at creation
dags_are_paused_at_creation = True
# The maximum number of active DAG runs per DAG
max_active_runs_per_dag = 55
这是我的配置,我也使用了postgresql作为已配置的后端数据库,直到昨天运行良好。
airflow scheduler
和airflow webserver
也在运行
但是当我运行airflow scheduler
时,它会卡在这里。
[2020-04-24 05:18:47,898] {__init__.py:51} INFO - Using executor LocalExecutor ____________ _____________
____ |__( )_________ __/__ /________ __ ____ /| |_ /__ ___/_ /_ __ /_ __ \_ | /| / /
___ ___ | / _ / _ __/ _ / / /_/ /_ |/ |/ / _/_/ |_/_/ /_/ /_/ /_/ \____/____/|__/
[2020-04-24 05:18:48,219] {scheduler_job.py:1315} INFO - Starting the scheduler
[2020-04-24 05:18:48,220] {scheduler_job.py:1323} INFO - Running execute loop for -1 seconds
[2020-04-24 05:18:48,220] {scheduler_job.py:1324} INFO - Processing each file at most -1 times
[2020-04-24 05:18:48,221] {scheduler_job.py:1327} INFO - Searching for files in /home/ubuntu/airflow/dags
[2020-04-24 05:18:48,234] {scheduler_job.py:1329} INFO - There are 50 files in /home/ubuntu/airflow/dags
[2020-04-24 05:18:48,320] {scheduler_job.py:1376} INFO - Resetting orphaned tasks for active dag runs
[2020-04-24 05:18:48,347] {dag_processing.py:545} INFO - Launched DagFileProcessorManager with pid: 21557
[2020-04-24 05:18:48,414] {settings.py:54} INFO - Configured default timezone <Timezone [UTC]>
[2020-04-24 05:18:48,423] {settings.py:213} INFO - settings.configure_orm(): Using pool settings. pool_size=0, max_overflow=-1, pool_recycle=1800, pid=21557 ```
我在这里想念东西吗?