BigQueryHook作业失败,错误:7916072

时间:2019-10-22 17:24:40

标签: google-bigquery google-cloud-composer

我正在使用BigQueryHook在自定义气流传感器中运行存储过程。昨晚它运行良好,我更新了传感器代码中的某些内容(与BQ挂钩无关),突然间它停止了工作。当我从UI运行该过程时,它会成功。

这是正在运行的查询:

BEGIN
  DECLARE saleExists BOOL;
  CALL project.exists("US", DATE "2019-2-1", saleExists);
  SELECT saleExists;
END

这是错误:

 {'reason': 'invalidQuery', 'location': 'query', 'message': 'domain: "cloud.helix.ErrorDomain" code: "INTERNAL_ERROR" argument: "Error: 7916072" debug_info: "[METADATA_ERROR] Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^, Reason: code=METADATA_ERROR message=Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^ debug=Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^ errorProto=domain: \\"cloud.helix.ErrorDomain\\"\\ncode: \\"INTERNAL_ERROR\\"\\nargument: \\"Error: 7916072\\"\\ndebug_info: \\"Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\\\n                                                     ^\\"\\n\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalExceptionNoHash(Exceptions.java:1390)\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalException(Exceptions.java:1382)\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalException(Exceptions.java:1365)\\n\\tat com.google.cloud.helix.common.Exceptions.access$200(Exceptions.java:92)\\n\\tat com.google.cloud.helix.common.Exceptions$Internal.internalError(Exceptions.java:1023)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerUtil.toHelixException(SpannerUtil.java:399)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerUtil.toHelixException(SpannerUtil.java:373)\\n\\tat com.google.cloud.helix.server.metadata.persistence.AbstractSpannerDao$RowCursorIterator.computeNext(AbstractSpannerDao.java:456)\\n\\tat com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)\\n\\tat com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)\\n\\tat java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1811)\\n\\tat java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126)\\n\\tat java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:498)\\n\\tat java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)\\n\\tat java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)\\n\\tat java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152)\\n\\tat java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)\\n\\tat java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:464)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerRoutineDao.getActiveRoutine(SpannerRoutineDao.java:90)\\n\\tat com.google.cloud.helix.server.routine.RoutineServiceUtil.lambda$authorizeAndLookupRoutine$1(RoutineServiceUtil.java:77)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$RetryCountingWork.run(SpannerTransactionContext.java:997)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResultInternal(SpannerTransactionContext.java:835)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResultInternal(SpannerTransactionContext.java:738)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.lambda$executeWithResult$1(SpannerTransactionContext.java:729)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithMonitoring(SpannerTransactionContext.java:937)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResult(SpannerTransactionContext.java:728)\\n\\tat com.google.cloud.helix.server.routine.RoutineServiceUtil.authorizeAndLookupRoutine(RoutineServiceUtil.java:74)\\n\\tat com.google.cloud.helix.server.rosy.GetRoutineImpl.process(GetRoutineImpl.java:68)\\n\\tat com.google.cloud.helix.server.rosy.AuthorizedStorageStubby.getRoutine(AuthorizedStorageStubby.java:109)\\n\\tat com.google.cloud.helix.proto2.Storage$ServiceParameters$25.handleBlockingRequest(Storage.java:2132)\\n\\tat com.google.cloud.helix.proto2.Storage$ServiceParameters$25.handleBlockingRequest(Storage.java:2130)\\n\\tat com.google.net.rpc3.impl.server.RpcBlockingApplicationHandler.handleRequest(RpcBlockingApplicationHandler.java:28)\\n\\tat com.google.net.rpc3.impl.server.RpcServerInternalContext.runRpcInApplication(RpcServerInternalContext.java:607)\\n\\tat com.google.net.rpc3.impl.server.RpcServerChannel$4.apply(RpcServerChannel.java:975)\\n\\tat com.google.net.rpc3.impl.server.RpcServerChannel$4.apply(RpcServerChannel.java:960)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:242)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:232)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:454)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:461)\\n\\tat io.grpc.Context.run(Context.java:575)\\n\\tat com.google.tracing.CurrentContext.runInContext(CurrentContext.java:206)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:320)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:311)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:458)\\n\\tat com.google.common.util.concurrent.MoreExecutors$5$1.run(MoreExecutors.java:1158)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:454)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:461)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:322)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:311)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:458)\\n\\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\\n\\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\\n\\tat java.lang.Thread.run(Thread.java:748)\\nCaused by: com.google.spanner.SpannerException: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^\\n\\tat com.google.spanner.InternalAccess.newSpannerException(InternalAccess.java:120)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.newExceptionWithStatus(SpannerExceptionFactory.java:57)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.throwWithStatus(SpannerExceptionFactory.java:53)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.throwWithStatus(SpannerExceptionFactory.java:48)\\n\\tat com.google.spanner.impl.ThinRowCursor.getNextReadResponse(ThinRowCursor.java:597)\\n\\tat com.google.spanner.impl.ThinRowCursor.tryNextInternal(ThinRowCursor.java:537)\\n\\tat com.google.spanner.impl.ThinRowCursor.next(ThinRowCursor.java:330)\\n\\tat com.google.cloud.helix.server.metadata.persistence.AbstractSpannerDao$RowCursorIterator.computeNext(AbstractSpannerDao.java:452)\\n\\t... 46 more\\n" at [3:8]'}. The job was: {'kind': 'bigquery#job', 'etag': '7n4/kLb4tXM1MqNnElC+nw==', 'id': ‘MYJOBID’, 'selfLink': 'https://bigquery.googleapis.com/bigquery/v2/projects/myproject/jobs/job_UcVj-3q1s80vpN7jO3uzrsk-P--T?location=US', 'user_email': ‘ouremail’, 'configuration': {'query': {'query': "BEGIN\n  DECLARE exists BOOL;\n  CALL Dataset.StoredProcedure(inputs…, exists);\n  SELECT exists;\nEND", 'priority': 'INTERACTIVE', 'useLegacySql': False}, 'jobType': 'QUERY'}, 'jobReference': {—taking this out for private info reasons—}, 'statistics': {'creationTime': '1571764174495', 'startTime': '1571764174576', 'endTime': '1571764175461', 'query': {'statementType': 'SCRIPT'}}, 'status': {'errorResult': {'reason': 'invalidQuery', 'location': 'query', 'message': 'domain: "cloud.helix.ErrorDomain" code: "INTERNAL_ERROR" argument: "Error: 7916072" debug_info: "[METADATA_ERROR] Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^, Reason: code=METADATA_ERROR message=Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^ debug=Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^ errorProto=domain: \\"cloud.helix.ErrorDomain\\"\\ncode: \\"INTERNAL_ERROR\\"\\nargument: \\"Error: 7916072\\"\\ndebug_info: \\"Spanner exception: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\\\n                                                     ^\\"\\n\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalExceptionNoHash(Exceptions.java:1390)\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalException(Exceptions.java:1382)\\n\\tat com.google.cloud.helix.common.Exceptions.getInternalException(Exceptions.java:1365)\\n\\tat com.google.cloud.helix.common.Exceptions.access$200(Exceptions.java:92)\\n\\tat com.google.cloud.helix.common.Exceptions$Internal.internalError(Exceptions.java:1023)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerUtil.toHelixException(SpannerUtil.java:399)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerUtil.toHelixException(SpannerUtil.java:373)\\n\\tat com.google.cloud.helix.server.metadata.persistence.AbstractSpannerDao$RowCursorIterator.computeNext(AbstractSpannerDao.java:456)\\n\\tat com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:141)\\n\\tat com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:136)\\n\\tat java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1811)\\n\\tat java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126)\\n\\tat java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:498)\\n\\tat java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)\\n\\tat java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)\\n\\tat java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152)\\n\\tat java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)\\n\\tat java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:464)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerRoutineDao.getActiveRoutine(SpannerRoutineDao.java:90)\\n\\tat com.google.cloud.helix.server.routine.RoutineServiceUtil.lambda$authorizeAndLookupRoutine$1(RoutineServiceUtil.java:77)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$RetryCountingWork.run(SpannerTransactionContext.java:997)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResultInternal(SpannerTransactionContext.java:835)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResultInternal(SpannerTransactionContext.java:738)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.lambda$executeWithResult$1(SpannerTransactionContext.java:729)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithMonitoring(SpannerTransactionContext.java:937)\\n\\tat com.google.cloud.helix.server.metadata.persistence.SpannerTransactionContext$Factory.executeWithResult(SpannerTransactionContext.java:728)\\n\\tat com.google.cloud.helix.server.routine.RoutineServiceUtil.authorizeAndLookupRoutine(RoutineServiceUtil.java:74)\\n\\tat com.google.cloud.helix.server.rosy.GetRoutineImpl.process(GetRoutineImpl.java:68)\\n\\tat com.google.cloud.helix.server.rosy.AuthorizedStorageStubby.getRoutine(AuthorizedStorageStubby.java:109)\\n\\tat com.google.cloud.helix.proto2.Storage$ServiceParameters$25.handleBlockingRequest(Storage.java:2132)\\n\\tat com.google.cloud.helix.proto2.Storage$ServiceParameters$25.handleBlockingRequest(Storage.java:2130)\\n\\tat com.google.net.rpc3.impl.server.RpcBlockingApplicationHandler.handleRequest(RpcBlockingApplicationHandler.java:28)\\n\\tat com.google.net.rpc3.impl.server.RpcServerInternalContext.runRpcInApplication(RpcServerInternalContext.java:607)\\n\\tat com.google.net.rpc3.impl.server.RpcServerChannel$4.apply(RpcServerChannel.java:975)\\n\\tat com.google.net.rpc3.impl.server.RpcServerChannel$4.apply(RpcServerChannel.java:960)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:242)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture$TransformFuture.doTransform(AbstractTransformFuture.java:232)\\n\\tat com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:454)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:461)\\n\\tat io.grpc.Context.run(Context.java:575)\\n\\tat com.google.tracing.CurrentContext.runInContext(CurrentContext.java:206)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:320)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:311)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:458)\\n\\tat com.google.common.util.concurrent.MoreExecutors$5$1.run(MoreExecutors.java:1158)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.runInContext(TraceContext.java:454)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable$1.run(TraceContext.java:461)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContextNoUnref(TraceContext.java:322)\\n\\tat com.google.tracing.TraceContext$AbstractTraceContextCallback.runInInheritedContext(TraceContext.java:311)\\n\\tat com.google.tracing.TraceContext$TraceContextRunnable.run(TraceContext.java:458)\\n\\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\\n\\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\\n\\tat java.lang.Thread.run(Thread.java:748)\\nCaused by: com.google.spanner.SpannerException: generic::INVALID_ARGUMENT: Name determinism_level not found inside t [at 1:304]\\n...t.details, t.signature, t.non_query_properties, t.determinism_level FROM A...\\n                                                     ^\\n\\tat com.google.spanner.InternalAccess.newSpannerException(InternalAccess.java:120)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.newExceptionWithStatus(SpannerExceptionFactory.java:57)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.throwWithStatus(SpannerExceptionFactory.java:53)\\n\\tat com.google.spanner.impl.SpannerExceptionFactory.throwWithStatus(SpannerExceptionFactory.java:48)\\n\\tat com.google.spanner.impl.ThinRowCursor.getNextReadResponse(ThinRowCursor.java:597)\\n\\tat com.google.spanner.impl.ThinRowCursor.tryNextInternal(ThinRowCursor.java:537)\\n\\tat com.google.spanner.impl.ThinRowCursor.next(ThinRowCursor.java:330)\\n\\tat com.google.cloud.helix.server.metadata.persistence.AbstractSpannerDao$RowCursorIterator.computeNext(AbstractSpannerDao.java:452)\\n\\t... 46 more\\n" at [3:8]'}, 'state': 'DONE'}

要强调的是,它昨晚正在运行,查询没有任何变化,因此不确定为什么会失败。当我在控制台中查看时,它也显示为失败,但是当我单击该作业并自己重新运行时,它会成功

对此错误有任何见解吗?有几个小时的截止日期,这只是停止工作,找不到先前的任何问题或提及此错误消息

0 个答案:

没有答案