Question

我正在尝试使用oozie运行sqoop（horton works）。这是我第一次尝试运行oozie工作流程并收到以下错误

Invoking Sqoop command line now
1811 [main] WARN org.apache.sqoop.tool.SqoopTool - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration. 
2015-12-21 16:58:45,913 WARN [main] tool.SqoopTool (SqoopTool.java:loadPluginsFromConfDir(177)) - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration. Intercepting System.exit(1) 
<<< Invocation of Main class completed 
<<< Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1] Oozie Launcher failed, finishing Hadoop job gracefully Oozie Launcher, uploading action data to HDFS sequence file: hdfs://****/user/root/oozie-oozi/0000006-151121191305655-oozie-oozi-W/sqoop-node--sqoop/action-data.seq 
2015-12-21 16:58:45,971 INFO [main] zlib.ZlibFactory (ZlibFactory.java:<clinit>(49)) - Successfully loaded & initialized native-zlib library 
2015-12-21 16:58:45,973 INFO [main] compress.CodecPool (CodecPool.java:getCompressor(153)) - Got brand-new compressor [.deflate] Oozie Launcher ends 
2015-12-21 16:58:45,995 INFO [main] mapred.Task (Task.java:done(1038)) - Task:attempt_1448133067660_0066_m_000000_0 is done. And is in the process of committing 
2015-12-21 16:58:46,033 INFO [main] mapred.Task (Task.java:commit(1199)) - Task attempt_1448133067660_0066_m_000000_0 is allowed to commit now 
2015-12-21 16:58:46,044 INFO [main] output.FileOutputCommitter (FileOutputCommitter.java:commitTask(482)) - Saved output of task 'attempt_1448133067660_0066_m_000000_0' to hdfs://ip-10-39-154-114:8020/user/root/oozie-oozi/0000006-151121191305655-oozie-oozi-W/sqoop-node--sqoop/output/_temporary/1/task_1448133067660_0066_m_000000 
2015-12-21 16:58:46,081 INFO [main] mapred.Task (Task.java:sendDone(1158)) - Task 'attempt_1448133067660_0066_m_000000_0' done.

Answer 1

不，没有必要设置$SQOOP_CONF_DIR，但如果你设置它就很好。并且您有一些与您的workflow.xml相关的问题。在某些情况下会发生此类问题：

workflow.xml有一些问题，比如你没有正确传递参数<command>...</command>。
sqoop * .jar不存在。等

但是如果你想检查真正的问题是什么，你可以通过命令行上的纱线日志检查它：

yarn logs -applicationId application_<app_id>

或您还可以在以下网址查看您的日志：

<IP_WHERE_HADOOP_DEPOLYED>:8088/cluster

oozie - sqoop $ SQOOP_CONF_DIR尚未在环境中设置

1 个答案: