Hbase批量加载异常(HFile版)

时间:2014-09-17 13:52:51

标签: java hbase hdfs bulk-load

我正在从HDFS将数据加载到HBase中。

 FileOutputFormat.setOutputPath(job, output);

 HTable table = new HTable(conf, tableName);
 HFileOutputFormat.configureIncrementalLoad(job, table);        
 .......    
 LoadIncrementalHFiles loader = new LoadIncrementalHFiles(config);
 loader.doBulkLoad(new Path(inPath), hTable);

以下是例外:

Caused by: java.lang.IllegalArgumentException: Invalid HFile version: 2099722 (expected to be between 2 and 3)
    at org.apache.hadoop.hbase.io.hfile.HFile.checkFormatVersion(HFile.java:888)
    at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(FixedFileTrailer.java:402)
    at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:537)

Exception in thread "main" org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from file hdfs:...
    at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:552)
    at org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:595)

你能建议一下吗?

提前致谢!

1 个答案:

答案 0 :(得分:1)

你试过跑吗:

  

hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles   pathToHFiles tableName