气流-D不起作用,不在后台运行

时间:2019-12-25 06:45:16

标签: airflow

我可以使用命令airflow webserver正常启动Web服务器。但是当我使用airflow webserver -D时,它显示:

/data/software/miniconda3/lib/python3.7/site-packages/airflow/config_templates/airflow_local_settings.py:65: DeprecationWarning: The elasticsearch_host option in [elasticsearch] has been renamed to host - the old setting has been used, but please update your config.
  ELASTICSEARCH_HOST = conf.get('elasticsearch', 'HOST')
/data/software/miniconda3/lib/python3.7/site-packages/airflow/config_templates/airflow_local_settings.py:67: DeprecationWarning: The elasticsearch_log_id_template option in [elasticsearch] has been renamed to log_id_template - the old setting has been used, but please update your config.
  ELASTICSEARCH_LOG_ID_TEMPLATE = conf.get('elasticsearch', 'LOG_ID_TEMPLATE')
/data/software/miniconda3/lib/python3.7/site-packages/airflow/config_templates/airflow_local_settings.py:69: DeprecationWarning: The elasticsearch_end_of_log_mark option in [elasticsearch] has been renamed to end_of_log_mark - the old setting has been used, but please update your config.
  ELASTICSEARCH_END_OF_LOG_MARK = conf.get('elasticsearch', 'END_OF_LOG_MARK')
[2019-12-25 06:37:49,537] {settings.py:252} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=855
  ____________       _____________
 ____    |__( )_________  __/__  /________      __
____  /| |_  /__  ___/_  /_ __  /_  __ \_ | /| / /
___  ___ |  / _  /   _  __/ _  / / /_/ /_ |/ |/ /
 _/_/  |_/_/  /_/    /_/    /_/  \____/____/|__/
[2019-12-25 06:37:50,031] {__init__.py:51} INFO - Using executor LocalExecutor
[2019-12-25 06:37:50,031] {dagbag.py:92} INFO - Filling up the DagBag from /data/projects/airflow/dags
Running the Gunicorn Server with:
Workers: 4 sync
Host: 0.0.0.0:8080
Timeout: 120
Logfiles: - -
================================================================= 

然后,以后没有任何进程在后台运行。我用命令ps -ef|grep airflow检查。

Airflow的版本为1.10.6

在以前的版本中,-D可以正常工作

1 个答案:

答案 0 :(得分:0)

如果您可以正常运行airflow webserverairflow webserver -D没有错误,并且您找不到作为气流Web服务器运行的进程。

一定是您杀死了airflow webserver -D的后台进程,并且您没有删除气流Web服务器的pid文件。

您可以转到$AIRFLOW_HOME/airflow目录,检查pid文件。如果存在但不为空,请将其删除并重试:

cd $AIRFLOW_HOME/airflow
rm airflow-webserver*.pid
airflow webserver -D