错误:java.lang.RuntimeException:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写

时间:2017-01-05 14:02:18

标签: hadoop hive hdfs hadoop2

蜂房> select * from tweets_text ORDER BY created_time ASC LIMIT 10;

URL:

http://standbynamenode-zat6kzjl.canopy.com:8088/taskdetails.jsp?jobid=job_1483098353987_0020&tipid=task_1483098353987_0020_m_000000

此任务的诊断消息: 错误:java.lang.RuntimeException:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写时的Hive运行时错误{“tweet_id”:814718430955900928,“created_unixtime”:1483078985333,“created_time”:“Fri Dec 30 06 :23:05 +0000 2016“,”lang“:”it“,”displayname“:”VentagliP“,”time_zone“:”Rome“,”msg“:”RT cristinafalasch Mi fa male al cuoreche lavirtùinpossa viver Liberadal morso dell'invidia         在org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:172)         在org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)         在org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)         在org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)         在org.apache.hadoop.mapred.YarnChild $ 2.run(YarnChild.java:168)         at java.security.AccessController.doPrivileged(Native Method)         在javax.security.auth.Subject.doAs(Subject.java:422)         在org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)         在org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) 引起:org.apache.hadoop.hive.ql.metadata.HiveException:处理可写时的Hive运行时错误{“tweet_id”:814718430955900928,“created_unixtime”:1483078985333,“created_time”:“Fri Dec 30 06:23:05 + 0000 2016“,”lang“:”it“,”displayname“:”VentagliP“,”time_zone“:”Rome“,”msg“:”RT cristinafalasch Mi fa male al cuoreche lavirtùinpossa viver liberadal morso dell'invidia         在org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:543)         在org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:163)         ......还有8个 引起:org.apache.hadoop.hive.serde2.SerDeException:Row不是有效的JSON对象 - JSONException:272处未终止的字符串[字符273第1行]         在org.openx.data.jsonserde.JsonSerDe.onMalformedJson(JsonSerDe.java:412)         在org.openx.data.jsonserde.JsonSerDe.deserialize(JsonSerDe.java:174)         在org.apache.hadoop.hive.ql.exec.MapOperator $ MapOpCtx.readRow(MapOperator.java:143)         在org.apache.hadoop.hive.ql.exec.MapOperator $ MapOpCtx.access $ 200(MapOperator.java:107)         在org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:534)         ... 9更多

失败:执行错误,从org.apache.hadoop.hive.ql.exec.mr.MapRedTask返回代码2 MapReduce工作推出: Stage-Stage-1:Map:3 Reduce:1 HDFS读取:0 HDFS写入:0 FAIL 总MapReduce CPU使用时间:0毫秒

1 个答案:

答案 0 :(得分:0)

首先检查hive-site.xml是否更新了所有必需的属性并转到了创建问题的代码。给出的网址不适合我。