从Hue运行Sqoop作业时出错

时间：2014-12-19 09:45:57

标签： sqoop

我正在尝试从顺化创建一个Sqoop作业;在＆＃34;工作设计师＆＃34;我创建了一个新工作输入teh命令来创建一个sqoop作业，如下所示。

sqoop job --create TestHiveImport -- import --connect jdbc:oracle:thin:@<ipaddress>:port/<database_name> --username <username> --password <password> --table TEST_SQOOP --hive-import --hive-table trade.test_sqoop --hive-drop-import-delims --incremental lastmodified --check-column LAST_MODIFIED --last-value "1970-01-01 00:01:01.0" -m 1

我提交工作后;我收到了以下错误。请帮忙，我完全陷入困境。

2014-12-19 09:19:40,928  INFO ActionStartXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@:start:] Start action [0000002-141008154216525-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-12-19 09:19:40,928  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@:start:] [***0000002-141008154216525-oozie-oozi-W@:start:***]Action status=DONE
2014-12-19 09:19:40,928  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@:start:] [***0000002-141008154216525-oozie-oozi-W@:start:***]Action updated in DB!
2014-12-19 09:19:40,950  INFO ActionEndXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@:start:] end executor for wf action 0000002-141008154216525-oozie-oozi-W with wf job 0000002-141008154216525-oozie-oozi-W
2014-12-19 09:19:41,018  INFO ActionStartXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] Start action [0000002-141008154216525-oozie-oozi-W@TestSqoop] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-12-19 09:19:41,179  WARN SqoopActionExecutor:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] credentials is null for the action
2014-12-19 09:19:41,495  INFO SqoopActionExecutor:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] Trying to get job [job_1415818455534_0502], attempt [1]
2014-12-19 09:19:41,507  INFO SqoopActionExecutor:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] checking action, external ID [job_1415818455534_0502] status [RUNNING]
2014-12-19 09:19:41,508  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] [***0000002-141008154216525-oozie-oozi-W@TestSqoop***]Action status=RUNNING
2014-12-19 09:19:41,509  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] [***0000002-141008154216525-oozie-oozi-W@TestSqoop***]Action updated in DB!
2014-12-19 09:19:52,651  INFO CallbackServlet:539 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] callback for action [0000002-141008154216525-oozie-oozi-W@TestSqoop]
2014-12-19 09:19:52,714  INFO SqoopActionExecutor:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] Trying to get job [job_1415818455534_0502], attempt [1]
2014-12-19 09:19:52,714  INFO SqoopActionExecutor:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] Trying to get job [job_1415818455534_0502], attempt [1]
2014-12-19 09:19:52,778  INFO SqoopActionExecutor:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] action completed, external ID [null]
2014-12-19 09:19:52,784  WARN SqoopActionExecutor:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], exit code [1]
2014-12-19 09:19:52,808  INFO ActionEndXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] end executor for wf action 0000002-141008154216525-oozie-oozi-W with wf job 0000002-141008154216525-oozie-oozi-W
2014-12-19 09:19:52,832  INFO ActionEndXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@TestSqoop] ERROR is considered as FAILED for SLA
2014-12-19 09:19:52,881  INFO ActionStartXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@kill] Start action [0000002-141008154216525-oozie-oozi-W@kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-12-19 09:19:52,882  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@kill] [***0000002-141008154216525-oozie-oozi-W@kill***]Action status=DONE
2014-12-19 09:19:52,882  WARN ActionStartXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@kill] [***0000002-141008154216525-oozie-oozi-W@kill***]Action updated in DB!
2014-12-19 09:19:52,904  INFO ActionEndXCommand:539 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[0000002-141008154216525-oozie-oozi-W@kill] end executor for wf action 0000002-141008154216525-oozie-oozi-W with wf job 0000002-141008154216525-oozie-oozi-W
2014-12-19 09:19:52,973  WARN CoordActionUpdateXCommand:542 - USER[scbengr2] GROUP[-] TOKEN[] APP[TestSqoop] JOB[0000002-141008154216525-oozie-oozi-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100

1 个答案:

答案 0 :(得分：0)

Hue目前有3 ways启动Sqoop：

  1. 工作设计师
  2. Sqoop app
  3. Oozie app

    4. 作业设计师在内部使用Oozie，因此您可以看到上面的输出。

    我发现您上面提供的命令有些问题：

    1. 该命令正在创建一个作业，而不是运行一个作业。
    2. 该命令包含sqoop，这将无法正常工作。
    3. 通过oozie创建作业需要external metastore，并且作业可以以某种方式进行此配置。

      4. 解决方案：

      1. 不要使用Metastore，而是尝试运行sqoop命令：import --connect jdbc:oracle:thin:@<ipaddress>:port/<database_name> --username <username> --password <password> --table TEST_SQOOP --hive-import --hive-table trade.test_sqoop --hive-drop-import-delims --incremental lastmodified --check-column LAST_MODIFIED --last-value "1970-01-01 00:01:01.0" -m 1。
      2. 不要在命令之前添加sqoop，而是尝试将其删除：job --create TestHiveImport -- import --connect jdbc:oracle:thin:@<ipaddress>:port/<database_name> --username <username> --password <password> --table TEST_SQOOP --hive-import --hive-table trade.test_sqoop --hive-drop-import-delims --incremental lastmodified --check-column LAST_MODIFIED --last-value "1970-01-01 00:01:01.0" -m 1。
      3. 您可以将Sqoop Metastore信息添加到sqoop-site.xml。请查看mailing lists以获取相关帮助。
相关问题
最新问题