气流调度程序拒绝以恶魔模式启动

Question

当我运行airflow scheduler时，广播工作（Airflow 1.9.0）

但是，如果我想使用airflow scheduler -D来运行，则无济于事。调度程序无法启动。

当我这样做时：ps aux | grep 'airflow'运行airflow scheduler -D之后，我看到：

为什么计划程序无法启动？

编辑： 我在airflow-scheduler.err文件中看到此错误：

Traceback (most recent call last):
  File "/usr/local/bin/airflow", line 27, in <module>
    args.func(args)
  File "/usr/local/lib/python2.7/dist-packages/airflow/bin/cli.py", line 817, in scheduler
    with ctx:
  File "/usr/local/lib/python2.7/dist-packages/daemon/daemon.py", line 397, in __enter__
    self.open()
  File "/usr/local/lib/python2.7/dist-packages/daemon/daemon.py", line 389, in open
    self.pidfile.__enter__()
  File "/usr/local/lib/python2.7/dist-packages/lockfile/__init__.py", line 197, in __enter__
    self.acquire()
  File "/usr/local/lib/python2.7/dist-packages/daemon/pidfile.py", line 60, in acquire
    super(TimeoutPIDLockFile, self).acquire(timeout, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/lockfile/pidlockfile.py", line 88, in acquire
    self.path)
lockfile.AlreadyLocked: /home/ubuntu/airflow/airflow-scheduler.pid is already locked

Answer 1

签入airflow-scheduler.err或airflow-scheduler.out-默认情况下，stderr和stdout重定向到该位置。

从您提到的错误（“ lockfile.AlreadyLocked：/home/ubuntu/airflow/airflow-scheduler.pid已被锁定”）开始，问题是以前调度程序退出时没有整理其锁定文件。短期修复是删除提到的PID文件。

下次崩溃时，请检查.err文件-它可能会提及为什么崩溃。还要检查的另一件事是，崩溃时间是否与您退出SSH会话一致？如果是这样，那么nohup可能会有所帮助。