hadoop-在Hive中处理行时发生Hive运行时错误

时间:2018-07-12 20:08:31

标签: hadoop hive bigdata hiveql amazon-emr

我只是在使用此查询select count(*) from tablename;

错误:状态:失败 状态:失败 顶点失败,vertexName = Map 1,vertexId = vertex_1531386888037_2424_1_00,诊断= [任务失败,taskId = task_1531386888037_2424_1_00_000007,诊断= [TaskAttempt 0失败,信息= [错误:运行任务时出错(失败):try_1531386888037_2424_1_00_000007_0:Exception.java。 java.lang.RuntimeException:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写null时,Hive运行时错误         在org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:211)         在org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:168)         在org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)         在org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:73)         在org.apache.tez.runtime.task.TaskRunner2Callable $ 1.run(TaskRunner2Callable.java:61)         在java.security.AccessController.doPrivileged(本机方法)         在javax.security.auth.Subject.doAs(Subject.java:422)         在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)         在org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)         在org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)         在org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)         在java.util.concurrent.FutureTask.run(FutureTask.java:266)         在java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)         在java.util.concurrent.ThreadPoolExecutor $ Worker.run(ThreadPoolExecutor.java:624)         在java.lang.Thread.run(Thread.java:748) 引起原因:java.lang.RuntimeException:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写null时,Hive运行时错误         在org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:95)         在org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70)         在org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419)         在org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:185)         ...另外14个 引起原因:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写null时,Hive运行时错误         在org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:560)         在org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:86)         ...另外17个 由以下原因引起:org.apache.hadoop.hive.serde2.SerDeException:org.codehaus.jackson.JsonParseException:无法识别的标记“ nullwable”:预期为“ null”,“ true”,“ false”或NaN  在[来源:java.io.ByteArrayInputStream@f10f60a;行:1,列:12]         在org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:180)         在org.apache.hadoop.hive.ql.exec.MapOperator $ MapOpCtx.readRow(MapOperator.java:127)         位于org.apache.hadoop.hive.ql.exec.MapOperator $ MapOpCtx.access $ 200(MapOperator.java:91)         在org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:546)         ...另外18个 由以下原因引起:org.codehaus.jackson.JsonParseException:无法识别的标记“ nullwable”:预期为“ null”,“ true”,“ false”或NaN  在[来源:java.io.ByteArrayInputStream@f10f60a;行:1,列:12]         在org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)         在org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)         在org.codehaus.jackson.impl.Utf8StreamParser._reportInvalidToken(Utf8StreamParser.java:2274)         在org.codehaus.jackson.impl.Utf8StreamParser._matchToken(Utf8StreamParser.java:2251)         在org.codehaus.jackson.impl.Utf8StreamParser._nextTokenNotInObject(Utf8StreamParser.java:587)         在org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:492)         在org.apache.hive.hcatalog.data.JsonSerDe.deserialize(JsonSerDe.java:169)         ...另外21个 ]],由于OWN_TASK_FAILURE,顶点未成功,失败了任务:1,任务:3,顶点vertex_1531386888037_2424_1_00 [Map 1]被杀死/失败,归因于:OWN_TASK_FAILURE]顶点被杀死,vertexName = Reducer 2,vertexId = vertex_1531386888037s = 424_1_01,处于RUNNING状态时,由于OTHER_VERTEX_FAILURE,顶点未成功,失败了,任务0:终止了任务:1,顶点Vertex_1531386888037_2424_1_01 [Reducer 2]被终止/失败,归因于:OTHER_VERTEX_FAILURE] DAG由于VERTEX_FAILURE而未能成功。 failedVertices:1 KilledVertices:1

`

请注意:select * from tablename;可以正常工作!

谢谢!

0 个答案:

没有答案