tez上的hive抛出java.lang.NoSuchMethodError

时间:2016-08-03 07:08:15

标签: hive apache-tez

我已经部署了tez并配置了配置单元以便在tez上工作。

简化查询在reducer阶段失败。

它抛出了这个错误:

状态:正在运行(在App ID为application_1469020577348_0014的YARN群集上执行)

暂停状态总已完成的运行暂停已杀死

Map 1 SUCCEEDED 0 0 0 0 0 0

Reducer 2 FAILED 1 0 0 1 4 0

VERTICES:01/02 [>> --------------------------] 0%已用时间:12.15秒

状态:失败 顶点失败,vertexName = Reducer 2,vertexId = vertex_1469020577348_0014_1_01,诊断= [任务失败,taskId = task_1469020577348_0014_1_01_000000,diagnostics = [TaskAttempt 0 failed,info = [错误:运行任务时出错(失败):attempt_1469020577348_0014_1_01_000000_0:java.lang.Exception: java.util.concurrent.ExecutionException:java.lang.NoSuchMethodError:org.apache.hadoop.mapred.TaskID:method(Ljava / lang / String; ILorg / apache / hadoop / mapreduce / TaskType; I)V not found     在org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:267)     at org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:69)     at org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:61)     at java.security.AccessController.doPrivileged(Native Method)     在javax.security.auth.Subject.doAs(Subject.java:415)     在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)     at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)     at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)     在org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)     在java.util.concurrent.FutureTask.run(FutureTask.java:262)     在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)     at java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:615)     在java.lang.Thread.run(Thread.java:745) 引起:java.util.concurrent.ExecutionException:java.lang.NoSuchMethodError:org.apache.hadoop.mapred.TaskID:method(Ljava / lang / String; ILorg / apache / hadoop / mapreduce / TaskType; I)V not found

1 个答案:

答案 0 :(得分:0)

此问题是因为您的配置单元已使用您正在使用的不同版本的tez进行编译。

https://issues.apache.org/jira/browse/HIVE-14356