MongoDb Hadoop连接器使用Pig支持连接问题

时间:2013-12-11 10:37:13

标签: mongodb hadoop apache-pig

ERROR 2118: Unable to connect to collection.Unable to connect to collection.

我的猪代码:

REGISTER /home/auto/ykale/jars/mongo/mongo-hadoop-pig_cdh3u3-1.1.0.jar
REGISTER /home/auto/ykale/jars/mongo/mongo-hadoop-core_cdh3u3-1.1.0.jar
REGISTER /home/auto/ykale/jars/mongo/mongo-hadoop-streaming_cdh3u3-1.1.0.jar
REGISTER /home/auto/ykale/jars/mongo/com.mongodb_2.6.5.1.jar
--name1 = load 'mongodb://hfdvmprmongodb1.vm.itg.corp.us.shldcorp.com:27017/member_pricing.testData' USING com.mongodb.hadoop.pig.MongoLoader;
name1 = load 'mongodb://ykale:newpassword4@hfdvmprmongodb1.vm.itg.corp.us.shldcorp.com:27017/member_pricing.testData' USING com.mongodb.hadoop.pig.MongoLoader;           
STORE name1 into '/user/ykale/mongo_dump/file1';                   

当我使用上面代码中注释掉的其他加载命令时,我得到如下输出,它分配0个map reduce作业。

2013-12-11 05:16:24,769 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
2013-12-11 05:16:24,769 [main] ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 0 map reduce job(s) failed!
2013-12-11 05:16:24,770 [main] INFO  org.apache.pig.tools.pigstats.PigStats - Script Statistics:

HadoopVersion   PigVersion      UserId  StartedAt       FinishedAt      Features
0.20.2-cdh3u3   0.8.1-cdh3u3    ykale   2013-12-11 05:16:22     2013-12-11 05:16:24     UNKNOWN

Failed!

Failed Jobs:
JobId   Alias   Feature Message Outputs

Input(s):

Output(s):

Counters:
Total records written : 0
Total bytes written : 0
Spillable Memory Manager spill count : 0
Total bags proactively spilled: 0
Total records proactively spilled: 0

Job DAG:
null


2013-12-11 05:16:24,770 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success!

我正在使用Dmongo.input.split.create_input_splits=false

执行Pig脚本

任何帮助表示感谢。

0 个答案:

没有答案