Apache Pig - ERROR 2998:未处理的内部错误。找到类org.apache.hadoop.mapreduce.JobContext,但是接口是预期的

时间:2015-04-20 12:33:28

标签: mongodb hadoop apache-pig

尝试简单加载mongodb集合并将其转储到bash中,但我得到了这个呃。找不到任何解决方案。我的代码:

grunt> REGISTER /home/thomasjsk/me/mongo-java-driver-2.13.1.jar
grunt> REGISTER /home/thomasjsk/me/mongo-hadoop-r1.3.2/core/build/libs/mongo-hadoop-core-1.3.2.jar
grunt> REGISTER /home/thomasjsk/me/mongo-hadoop-r1.3.2/pig/build/libs/mongo-hadoop-pig-1.3.2.jar


grunt> raw = LOAD 'mongodb://localhost:27017/agile_data.email' using com.mongodb.hadoop.pig.MongoLoader();
2015-04-20 14:28:00,123 [main] INFO  com.mongodb.hadoop.pig.MongoStorage - Initializing MongoLoader in dynamic schema mode.
2015-04-20 14:28:00,199 [main] INFO  com.mongodb.hadoop.pig.MongoStorage - Initializing MongoLoader in dynamic schema mode.
grunt> dump raw
2015-04-20 14:28:07,510 [main] WARN  org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-04-20 14:28:07,543 [main] INFO  com.mongodb.hadoop.pig.MongoStorage - Initializing MongoLoader in dynamic schema mode.
2015-04-20 14:28:07,578 [main] INFO  org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: UNKNOWN
2015-04-20 14:28:07,650 [main] INFO  org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED=[AddForEach, ColumnMapKeyPrune, GroupByConstParallelSetter, LimitOptimizer, LoadTypeCastInserter, MergeFilter, MergeForEach, PartitionFilterOptimizer, PushDownForEachFlatten, PushUpFilter, SplitFilter, StreamTypeCastInserter], RULES_DISABLED=[FilterLogicExpressionSimplifier]}
2015-04-20 14:28:07,903 [main] INFO  com.mongodb.hadoop.pig.MongoStorage - Initializing MongoLoader in dynamic schema mode.
2015-04-20 14:28:07,906 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2998: Unhandled internal error. Found class org.apache.hadoop.mapreduce.JobContext, but interface was expected

我可以加载一个文件并正常转储它,这个只在我试图搞乱mongo的时候才会发生。

[Pig v0.13.0]

0 个答案:

没有答案