im new with cloudera ....,我已经在使用oozie,flume,hive和impala ......,我有一个手动按我想要的方式工作。我想用oozie来改进功能以优化流程。 Flume,不存在因为Flume不需要安排,只需使用oozie进行蜂巢和黑斑羚。 当数据来到Hive ...时,想法是将信息复制到另一个支持镶木地板格式的表格并在Impala上阅读.... 我试图将信息从一个表覆盖到另一个表,手动它完美地工作,但是当我做
时INSERT OVERWRITE TABLE table_impala SELECT * FROM table_hive
oozie永远不会结束工作流程并始终保持50%......我将hive-site.xml复制到HDFS路径并添加到xml。
2017-11-24 07:05:43,184 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] Start action [0000068-171123082943192-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-11-24 07:05:43,185 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] [***0000068-171123082943192-oozie-oozi-W@:start:***]Action status=DONE
2017-11-24 07:05:43,185 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] [***0000068-171123082943192-oozie-oozi-W@:start:***]Action updated in DB!
2017-11-24 07:05:43,256 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W@:start:
2017-11-24 07:05:43,256 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W
2017-11-24 07:05:43,294 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] Start action [0000068-171123082943192-oozie-oozi-W@hive-8ab7] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-11-24 07:05:46,435 INFO org.apache.oozie.action.hadoop.Hive2ActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] checking action, hadoop job ID [job_1511505168592_0020] status [RUNNING]
2017-11-24 07:05:46,442 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] [***0000068-171123082943192-oozie-oozi-W@hive-8ab7***]Action status=RUNNING
2017-11-24 07:05:46,443 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Hive] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] [***0000068-171123082943192-oozie-oozi-W@hive-8ab7***]Action updated in DB!
2017-11-24 07:05:46,470 INFO org.apache.oozie.command.wf.WorkflowNotificationXCommand: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000068-171123082943192-oozie-oozi-W] ACTION[0000068-171123082943192-oozie-oozi-W@hive-8ab7] No Notification URL is defined. Therefore nothing to notify for job 0000068-171123082943192-oozie-oozi-W@hive-8ab7