气流-计划中的依赖项阻止任务

时间:2020-10-10 14:46:34

标签: airflow

我有一个示例气流触发来触发bash命令。执行成功,但是我从python运算符调用了bash运算符。

from airflow import DAG
from airflow.operators.bash_operator import BashOperator
from airflow.utils.dates import days_ago
from airflow.operators.python_operator import PythonOperator

args = {
    'owner': 'airflow',
    'depends_on_past': False,
    'start_date': days_ago(2)
    }

main_dag = DAG(
    'bhuvitest',
    default_args=args,
    description='A simple tutorial DAG',
    schedule_interval=timedelta(days=1),
    catchup=False
)

def func(**context):
    t1 = BashOperator(
            task_id='print_date',
            bash_command='touch /tmp/aaaaaaaaaaaaa',
            dag=main_dag
        )
    t1
bhuvitest = PythonOperator(
        task_id='python_task', 
        python_callable=func,
        dag = main_dag)
 
bhuvitest

日志:

*** Reading local file: /root/airflow/logs/bhuvitest/python_task/2020-10-10T14:23:48.382053+00:00/1.log
[2020-10-10 14:23:59,898] {taskinstance.py:670} INFO - Dependencies all met for <TaskInstance: bhuvitest.python_task 2020-10-10T14:23:48.382053+00:00 [queued]>
[2020-10-10 14:23:59,918] {taskinstance.py:670} INFO - Dependencies all met for <TaskInstance: bhuvitest.python_task 2020-10-10T14:23:48.382053+00:00 [queued]>
[2020-10-10 14:23:59,919] {taskinstance.py:880} INFO - 
--------------------------------------------------------------------------------
[2020-10-10 14:23:59,919] {taskinstance.py:881} INFO - Starting attempt 1 of 1
[2020-10-10 14:23:59,919] {taskinstance.py:882} INFO - 
--------------------------------------------------------------------------------
[2020-10-10 14:23:59,933] {taskinstance.py:901} INFO - Executing <Task(PythonOperator): python_task> on 2020-10-10T14:23:48.382053+00:00
[2020-10-10 14:23:59,936] {standard_task_runner.py:54} INFO - Started process 7727 to run task
[2020-10-10 14:23:59,955] {standard_task_runner.py:77} INFO - Running: ['airflow', 'run', 'bhuvitest', 'python_task', '2020-10-10T14:23:48.382053+00:00', '--job_id', '3749', '--pool', 'default_pool', '--raw', '-sd', 'DAGS_FOLDER/bhuvitest.py', '--cfg_path', '/tmp/tmpcy3wod84']
[2020-10-10 14:23:59,956] {standard_task_runner.py:78} INFO - Job 3749: Subtask python_task
[2020-10-10 14:23:59,997] {logging_mixin.py:112} INFO - Running %s on host %s <TaskInstance: bhuvitest.python_task 2020-10-10T14:23:48.382053+00:00 [running]> bhuvi.c.searce-academy.internal
[2020-10-10 14:24:00,025] {python_operator.py:114} INFO - Done. Returned value was: None
[2020-10-10 14:24:00,038] {taskinstance.py:1070} INFO - Marking task as SUCCESS.dag_id=bhuvitest, task_id=python_task, execution_date=20201010T142348, start_date=20201010T142359, end_date=20201010T142400
[2020-10-10 14:24:04,888] {local_task_job.py:102} INFO - Task exited with return code 0

但是bash运算符没有触发。 enter image description here

0 个答案:

没有答案