我已经部署了tez并配置了配置单元以便在tez上工作。
简化查询在reducer阶段失败。
它抛出了这个错误:
状态:正在运行(在App ID为application_1469020577348_0014的YARN群集上执行)
Map 1 SUCCEEDED 0 0 0 0 0 0
状态:失败 顶点失败,vertexName = Reducer 2,vertexId = vertex_1469020577348_0014_1_01,诊断= [任务失败,taskId = task_1469020577348_0014_1_01_000000,diagnostics = [TaskAttempt 0 failed,info = [错误:运行任务时出错(失败):attempt_1469020577348_0014_1_01_000000_0:java.lang.Exception: java.util.concurrent.ExecutionException:java.lang.NoSuchMethodError:org.apache.hadoop.mapred.TaskID:method(Ljava / lang / String; ILorg / apache / hadoop / mapreduce / TaskType; I)V not found 在org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.initialize(LogicalIOProcessorRuntimeTask.java:267) at org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:69) at org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:61) at java.security.AccessController.doPrivileged(Native Method) 在javax.security.auth.Subject.doAs(Subject.java:415) 在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61) at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37) 在org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36) 在java.util.concurrent.FutureTask.run(FutureTask.java:262) 在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:615) 在java.lang.Thread.run(Thread.java:745) 引起:java.util.concurrent.ExecutionException:java.lang.NoSuchMethodError:org.apache.hadoop.mapred.TaskID:method(Ljava / lang / String; ILorg / apache / hadoop / mapreduce / TaskType; I)V not found
答案 0 :(得分:0)
此问题是因为您的配置单元已使用您正在使用的不同版本的tez进行编译。