如何使用hadoop2.2在oozie-4.0.1中执行pig-0.12.1工作流程

时间:2014-05-27 06:18:37

标签: hadoop workflow apache-pig scheduling oozie

我使用的是hadoop-2.2,oozie-4.0.1和pig-0.12.1。现在我将猪库文件移动到hdfs中共享/ lib / pig。 在oozie中执行pig脚本时,它会运行状态然后被杀死。它永远不会进入成熟状态。

日志错误:

 2014-05-27 11:37:00,404  WARN PigActionExecutor:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@pigAction] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.PigMain], exit code [2]
 2014-05-27 11:37:00,522  INFO ActionEndXCommand:539 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@pigAction] ERROR is considered as FAILED for SLA
 2014-05-27 11:37:00,565  INFO ActionStartXCommand:539 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] Start action [0000011-140527092721822-oozie-labu-W@killJobAction] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
 2014-05-27 11:37:00,566  WARN ActionStartXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] [***0000011-140527092721822-oozie-labu-W@killJobAction***]Action status=DONE
 2014-05-27 11:37:00,566  WARN ActionStartXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[0000011-140527092721822-oozie-labu-W@killJobAction] [***0000011-140527092721822-oozie-labu-W@killJobAction***]Action updated in DB!
 2014-05-27 11:37:00,629  WARN CoordActionUpdateXCommand:542 - USER[labuser] GROUP[-] TOKEN[] APP[WorkflowWithPigAction] JOB[0000011-140527092721822-oozie-labu-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100

这是我的工作流程:

<workflow-app name="WorkflowWithPigAction" xmlns="uri:oozie:workflow:0.1">
<start to="pigAction"/>
<action name="pigAction">
<pig>
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<script>script.pig</script>
</pig>
<ok to="end"/>
<error to="killJobAction"/>
</action>
<kill name="killJobAction">
<message>"Killed job due to error: ${wf:errorMessage(wf:lastErrorNode())}"</message>
</kill>
<end name="end" />
</workflow-app>

这是我的job.properties:

nameNode=hdfs://localhost:8020
jobTracker=localhost:8032
queueName=default

oozie.libpath=${nameNode}/user/${user.name}/share/lib
oozie.use.system.libpath=true
oozie.wf.rerun.failnodes=true

oozieProjectRoot=${nameNode}/user/${user.name}/ooziepig
appPath=${oozieProjectRoot}/workflow.xml
oozie.wf.application.path=${appPath}

我认为jar文件的问题....任何人都可以告诉我oozie-4.0.1中的pig-12.0.1的必要文件uo hadoop-2.2

帮助我.....

0 个答案:

没有答案