OZie工作流处于EMR的SUSPENDED状态

时间:2016-09-26 07:28:22

标签: oozie emr

运行Oozie软件包时,我们看到一些工作流程进入SUSPENDED状态。该工作实际上成功,但Oozie将工作流程置于SUSPENDED状态,工作永远不会完成。这仅在少数工作流程中发生,而其他工作流程成功。

Oozie错误:

JA009   JA009: Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]       
Back


Detailed log:
2016-09-22 09:15:35,674  WARN PigActionExecutor:523 - SERVER[ip-10-39-155-120.ec2.internal] USER[hadoop] GROUP[-] TOKEN[] APP[sourceCustomerDimGlobal-wf] JOB[0000066-160921113823531-oozie-oozi-W] ACTION[0000066-160921113823531-oozie-oozi-W@Pig-scdGlobalTransformation] Exception in check(). Message[Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]]
java.io.IOException: Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]
    at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:357)
    at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:428)
    at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:572)
    at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:184)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:593)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:591)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:591)
    at org.apache.hadoop.mapred.JobClient.getJobInner(JobClient.java:601)
    at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:631)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.getRunningJob(JavaActionExecutor.java:1333)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1356)
    at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:182)
    at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
    at org.apache.oozie.command.XCommand.call(XCommand.java:286)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
2016-09-22 09:15:35,675  WARN ActionCheckXCommand:523 - SERVER[ip-10-39-155-120.ec2.internal] USER[hadoop] GROUP[-] TOKEN[] APP[sourceCustomerDimGlobal-wf] JOB[0000066-160921113823531-oozie-oozi-W] ACTION[0000066-160921113823531-oozie-oozi-W@Pig-scdGlobalTransformation] Exception while executing check(). Error Code [JA009], Message[JA009: Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]]
org.apache.oozie.action.ActionExecutorException: JA009: Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]
    at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:456)
    at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:440)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1456)
    at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:182)
    at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
    at org.apache.oozie.command.XCommand.call(XCommand.java:286)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Failed to load class: [org.apache.hadoop.mapreduce.v2.api.impl.pb.client.MRClientProtocolPBClientImpl]
    at org.apache.hadoop.mapred.ClientServiceDelegate.invoke(ClientServiceDelegate.java:357)
    at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:428)
    at org.apache.hadoop.mapred.YARNRunner.getJobStatus(YARNRunner.java:572)
    at org.apache.hadoop.mapreduce.Cluster.getJob(Cluster.java:184)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:593)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:591)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
    at org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:591)
    at org.apache.hadoop.mapred.JobClient.getJobInner(JobClient.java:601)
    at org.apache.hadoop.mapred.JobClient.getJob(JobClient.java:631)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.getRunningJob(JavaActionExecutor.java:1333)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1356)
    ... 9 more

0 个答案:

没有答案