AIrflow突然停止触发Dags

时间:2020-04-24 06:14:23

标签: python python-3.x postgresql airflow airflow-scheduler

气流版本:1.10.5

气流突然停止运行,我正在使用 LocalExecutor ,我不知道为什么它停止运行, 我在airflow / dags目录中大约有50个文件。 其中一些处于暂停状态,但过去两个月以来一直在那里。


# The number of task instances allowed to run concurrently by the scheduler
dag_concurrency = 60

# Are DAGs paused by default at creation
dags_are_paused_at_creation = True

# The maximum number of active DAG runs per DAG
max_active_runs_per_dag = 55

这是我的配置,我也使用了postgresql作为已配置的后端数据库,直到昨天运行良好。 airflow schedulerairflow webserver也在运行

但是当我运行airflow scheduler时,它会卡在这里。

[2020-04-24 05:18:47,898] {__init__.py:51} INFO - Using executor LocalExecutor                                                                                                                                ____________       _____________                                                                                                                                                                          
 ____    |__( )_________  __/__  /________      __                                                                                                                                                          ____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /                                                                                                                                                          
___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /                                                                                                                                                            _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/                                                                                                                                                            
[2020-04-24 05:18:48,219] {scheduler_job.py:1315} INFO - Starting the scheduler                                                                                                                             
[2020-04-24 05:18:48,220] {scheduler_job.py:1323} INFO - Running execute loop for -1 seconds                                                               
[2020-04-24 05:18:48,220] {scheduler_job.py:1324} INFO - Processing each file at most -1 times                                                                                                              
[2020-04-24 05:18:48,221] {scheduler_job.py:1327} INFO - Searching for files in /home/ubuntu/airflow/dags                                                                                                   
[2020-04-24 05:18:48,234] {scheduler_job.py:1329} INFO - There are 50 files in /home/ubuntu/airflow/dags                                                                                                    
[2020-04-24 05:18:48,320] {scheduler_job.py:1376} INFO - Resetting orphaned tasks for active dag runs                                                                   
[2020-04-24 05:18:48,347] {dag_processing.py:545} INFO - Launched DagFileProcessorManager with pid: 21557                                                                                                   
[2020-04-24 05:18:48,414] {settings.py:54} INFO - Configured default timezone <Timezone [UTC]>                                                                          
[2020-04-24 05:18:48,423] {settings.py:213} INFO - settings.configure_orm(): Using pool settings. pool_size=0, max_overflow=-1, pool_recycle=1800, pid=21557 ```

我在这里想念东西吗?

0 个答案:

没有答案