Question

我正在从DataflowJavaSDK-Examples文件夹中运行WordCount示例。

mvn compile exec:java -exec.mainClass=com.google.cloud.dataflow.examples.WordCount -Dexec.args="--project=<YOUR CLOUD PLATFORM PROJECT ID> --stagingLocation=<YOUR CLOUD STORAGE LOCATION> --runner=BlockingDataflowPipelineRunner --inputFile=gs://df1/L1.txt --output=gs://df1"

我得到以下内容。它现在运行了20分钟。

2015年10月12日上午9:32:36 com.google.cloud.dataflow.sdk.runners.DataflowPipelineJo b getJobWithRetries

警告：获取当前作业状态时出现问题：429请求太多

{  
  "code" : 429,  
  "errors" : [ {  
    "domain" : "global",  
    "message" : "Request throttled due to project QPS limit being reached.",  
    "reason" : "rateLimitExceeded"  
  } ],  
  "message" : "Request throttled due to project QPS limit being reached.",  
  "status" : "RESOURCE_EXHAUSTED"  
}.

Answer 1

这表示在BlockingDataflowPipelineRunner中轮询作业状态的问题，这不会影响作业执行。您应该能够在monitoring UI或CLI中验证作业的状态。至于为何你这么做，你是否试图同时监控多个工作？

数据流WordCount卡住了

1 个答案: