Cloud Dataflow 429错误 - “资源已耗尽(例如检查配额)。”

时间:2015-05-05 04:17:46

标签: google-cloud-dataflow

我们的一个工作开始抛出以下警告/错误:

856573 [main] WARN  com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob  - There were problems getting current job status: 
com.google.api.client.googleapis.json.GoogleJsonResponseException: 429 Too Many Requests
{
  "code" : 429,
  "errors" : [ {
    "domain" : "global",
    "message" : "Resource has been exhausted (e.g. check quota).",
    "reason" : "rateLimitExceeded"
  } ],
  "message" : "Resource has been exhausted (e.g. check quota).",
  "status" : "RESOURCE_EXHAUSTED"
}
    at com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:145)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
    at com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest$1.interceptResponse(AbstractGoogleClientRequest.java:321)
    at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:1056)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:419)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
    at com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
    at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.getState(DataflowPipelineJob.java:188)
    at com.google.cloud.dataflow.sdk.runners.DataflowPipelineJob.waitToFinish(DataflowPipelineJob.java:126)
    at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:86)
    at com.google.cloud.dataflow.sdk.runners.BlockingDataflowPipelineRunner.run(BlockingDataflowPipelineRunner.java:47)
    at com.google.cloud.dataflow.sdk.Pipeline.run(Pipeline.java:145)
    at com.tls.cdf.job.AbstractCloudDataFlowJob.execute(AbstractCloudDataFlowJob.java:100)
    at com.tls.cdf.CloudDataFlowJobExecutor.main(CloudDataFlowJobExecutor.java:44)

起初我们虽然这是为作业分配所需资源(VM)的错误,但实际上工作运行良好并且能够根据需要扩展。似乎是在尝试检索作业状态时是问题。

有趣的是,每次在应用程序中抛出错误时(在作业运行时都会报告多个错误),开发人员控制台也会这样做:

enter image description here

职位名称为: 2015-05-04_20_49_53-2521857061976321751

这个警告/错误是什么?

1 个答案:

答案 0 :(得分:2)

我们的最终报告监控信息存在问题。我们已经推翻了这一改变,你现在应该做得很好。如果您仍有问题,请告诉我们。对不起,对不起!