由于VERTEX_FAILURE,DAG无法成功。 failedVertices:1 KilledVertices:1

时间:2019-08-06 15:12:05

标签: hadoop hive

我正在尝试在蜂巢中执行一些查询,并得到以下错误。 Hadoop配置是否存在任何错误配置?

  

顶点被杀死,vertexName = Reducer 2,   vertexId = vertex_1565100806749_0002_1_01,诊断信息= [已收到顶点   以“已初始化”状态杀死。Vertex vertex_1565100806749_0002_1_01 [Reducer   2]因以下原因而被杀/失败:OTHER_VERTEX_FAILURE] DAG未成功,原因是   到VERTEX_FAILURE。 failedVertices:1 killedVertices:1 FAILED:Execution   错误,从org.apache.hadoop.hive.ql.exec.tez.TezTask返回代码2。   顶点失败,vertexName = Map 1,   vertexId = vertex_1565100806749_0002_1_00,诊断= [顶点   vertex_1565100806749_0002_1_00 [地图1]已终止/失败   到:ROOT_INPUT_INIT_FAILURE,顶点输入:prop_header_orc初始值设定项   失败,顶点= vertex_1565100806749_0002_1_00 [Map 1],   java.lang.IllegalArgumentException:非法容量:-15667           在java.util.ArrayList。(ArrayList.java:157)           在org.apache.tez.mapreduce.grouper.TezSplitGrouper.getGroupedSplits(TezSplitGrouper.java:189)           在org.apache.hadoop.mapred.split.TezMapredSplitsGrouper.getGroupedSplits(TezMapredSplitsGrouper.java:81)           在org.apache.hadoop.hive.ql.exec.tez.SplitGrouper.group(SplitGrouper.java:91)           在org.apache.hadoop.hive.ql.exec.tez.SplitGrouper.generateGroupedSplits(SplitGrouper.java:193)           在org.apache.hadoop.hive.ql.exec.tez.SplitGrouper.generateGroupedSplits(SplitGrouper.java:160)           在org.apache.hadoop.hive.ql.exec.tez.HiveSplitGenerator.initialize(HiveSplitGenerator.java:287)           在org.apache.tez.dag.app.dag.RootInputInitializerManager $ InputInitializerCallable $ 1.run(RootInputInitializerManager.java:278)           在org.apache.tez.dag.app.dag.RootInputInitializerManager $ InputInitializerCallable $ 1.run(RootInputInitializerManager.java:269)           在java.security.AccessController.doPrivileged(本机方法)           在javax.security.auth.Subject.doAs(Subject.java:422)           在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)           在org.apache.tez.dag.app.dag.RootInputInitializerManager $ InputInitializerCallable.call(RootInputInitializerManager.java:269)           在org.apache.tez.dag.app.dag.RootInputInitializerManager $ InputInitializerCallable.call(RootInputInitializerManager.java:253)           在com.google.common.util.concurrent.TrustedListenableFutureTask $ TrustedFutureInterruptibleTask.runInterruptible(TrustedListenableFutureTask.java:108)           在com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:41)           在com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:77)           在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)           在java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:624)           at java.lang.Thread.run(Thread.java:748)]杀死顶点,vertexName = Reducer 2,vertexId = vertex_1565100806749_0002_1_01,   diagnostics = [顶点在INITED状态下收到杀死。   vertex_1565100806749_0002_1_01 [Reducer 2]已终止/失败   to:OTHER_VERTEX_FAILURE]由于VERTEX_FAILURE,DAG无法成功。   failedVertices:1 KilledVertices:1

0 个答案:

没有答案