无法使用Airflow中的httpMethod和URL获取数据流作业状态

时间:2018-10-29 12:01:30

标签: python-2.7 google-cloud-dataflow airflow

  1. 我正在通过airflow v1.10.0(安装在本地计算机中)提交数据流作业

  2. 作业已提交并成功执行,但气流不会根据作业状态而退出。

有人可以帮助解决此问题

Triggering dataflow using airflow

中提供了相同的代码块

下面是日志消息

[2018-10-29 16:47:48,313] {gcp_dataflow_hook.py:128} WARNING - INFO:root:Job 
2018-10-29_04_17_36-2871901639034996418 is in state JOB_STATE_RUNNING
[2018-10-29 16:47:48,313] {gcp_dataflow_hook.py:128} WARNING - INFO:root:2018- 
10-29T11:17:42.201Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
[2018-10-29 16:47:48,313] {gcp_dataflow_hook.py:128} WARNING - INFO:root:Job 
2018-10-29_04_17_36-2871901639034996418 is in state JOB_STATE_DONE
[2018-10-29 16:47:48,314] {gcp_api_base_hook.py:90} INFO - Getting connection 
using a JSON key file.
[2018-10-29 16:47:48,319] {discovery.py:267} INFO - URL being requested: GET 
https://www.googleapis.com/discovery/v1/apis/dataflow/v1b3/rest
[2018-10-29 16:47:52,744] {discovery.py:866} INFO - URL being requested: GET 
https://dataflow.googleapis.com/v1b3/projects/dataflow-219809/locations/us- 
central1/jobs?alt=json
[2018-10-29 16:47:55,060] {gcp_dataflow_hook.py:77} INFO - Google Cloud 
DataFlow job not available yet..

0 个答案:

没有答案