如何修复hive Metastore中的索引是否已损坏。和分区表抛出错误

时间:2014-05-29 02:00:38

标签: postgresql hadoop hive hdfs metastore

我正在开发一个使用CDH嵌入式postGreSQL的项目。 几天前我们开始识别两件事。 由Sqoop创建的表(配置单元表)失败,以及从配置单元创建动态分区表也失败。

错误如下

第一天:

Loading data to table raw_store.user_pdp_visits partition (view_date=null)
Failed with exception MetaException(message:javax.jdo.JDODataStoreException: Insert of object "org.apache.hadoop.hive.metastore.model.MPartition@67d2b6c" using statemen
t "INSERT INTO "PARTITIONS" ("PART_ID","PART_NAME","TBL_ID","LAST_ACCESS_TIME","CREATE_TIME","SD_ID") VALUES (?,?,?,?,?,?)" failed : ERROR: duplicate key value violates
 unique constraint "PARTITIONS_pkey"
  Detail: Key ("PART_ID")=(481) already exists.
NestedThrowables:
org.postgresql.util.PSQLException: ERROR: duplicate key value violates unique constraint "PARTITIONS_pkey"
  Detail: Key ("PART_ID")=(481) already exists.)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Therafter:

Moving data to: hdfs://hadoop01.snapdeal.com:8020/tmp/hive-hdfs/hive_2014-05-27_09-00-19_755_4383214683545337621-1/-ext-10000/view_date=2014-05-26
Loading data to table raw_store.user_pdp_visits partition (view_date=null)
Failed with exception MetaException(message:java.lang.RuntimeException: commitTransaction was called but openTransactionCalls = 0. This probably indicates that there ar
e unbalanced calls to openTransaction/commitTransaction)
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

如果有人可以为此提供一些解决方案,那将是非常好的。

0 个答案:

没有答案