无法在猪

时间:2016-09-17 10:19:44

标签: hadoop apache-pig

climate = LOAD '/home/MOCK_DATA.csv' USING PigStorage(','); 
DUMP climate;

我收到此错误。

  

2016-09-17 15:44:03,880 [main] INFO   org.apache.pig.tools.pigstats.ScriptState - 使用的Pig功能   脚本:UNKNOWN 2016-09-17 15:44:03,910 [主要]信息   org.apache.hadoop.conf.Configuration.deprecation -   io.bytes.per.checksum已弃用。相反,使用   dfs.bytes-per-checksum 2016-09-17 15:44:03,910 [主要]信息   org.apache.hadoop.conf.Configuration.deprecation - fs.default.name是   弃用。相反,请使用fs.defaultFS 2016-09-17 15:44:03,910 [main]   INFO org.apache.pig.data.SchemaTupleBackend - 键[pig.schematuple]   未设置...将不会生成代码。 2016-09-17 15:44:03,911 [主要]   INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer -   {RULES_ENABLED = [AddForEach,ColumnMapKeyPrune,ConstantCalculator,   GroupByConstParallelSetter,LimitOptimizer,LoadTypeCastInserter,   MergeFilter,MergeForEach,PartitionFilterOptimizer,   PredicatePushdownOptimizer,PushDownForEachFlatten,PushUpFilter,   SplitFilter,StreamTypeCastInserter]} 2016-09-17 15:44:03,911 [main]   信息   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler    - 文件级联阈值:100乐观? false 2016-09-17 15:44:03,913 [主要] INFO   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer    - 优化前的MR计划规模:1 2016-09-17 15:44:03,913 [主要]信息   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer    - 优化后的MR计划规模:1 2016-09-17 15:44:03,926 [main] INFO org.apache.hadoop.conf.Configuration.deprecation -   io.bytes.per.checksum已弃用。相反,使用   dfs.bytes-per-checksum 2016-09-17 15:44:03,927 [主要]信息   org.apache.hadoop.conf.Configuration.deprecation - fs.default.name是   弃用。相反,请使用fs.defaultFS 2016-09-17 15:44:03,928 [main]   INFO org.apache.hadoop.metrics.jvm.JvmMetrics - 无法初始化JVM   processName = JobTracker,sessionId =已经初始化的度量标准   2016-09-17 15:44:03,929 [主要]信息   org.apache.pig.tools.pigstats.mapreduce.MRScriptState - Pig脚本   设置被添加到作业2016-09-17 15:44:03,929 [主要]信息   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler    - mapred.job.reduce.markreset.buffer.percent未设置,设置为默认值0.3 2016-09-17 15:44:03,932 [main] INFO   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler    - 设置单店作业2016-09-17 15:44:03,940 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 1个map-reduce等待提交的工作。 2016-09-17 15:44:03,949 [JobControl] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - 不能   使用processName = JobTracker初始化JVM指标,sessionId = -   已经初始化2016-09-17 15:44:03,950 [JobControl] ERROR   org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl - 同时出错   试图运行工作。 java.lang.IncompatibleClassChangeError:找到了   接口org.apache.hadoop.mapreduce.JobContext,但是类是   预计在   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:243)     在   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:191)     在   org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562)     在   org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)     在org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1296)at at   org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1293)at at   java.security.AccessController.doPrivileged(Native Method)at   javax.security.auth.Subject.doAs(Subject.java:422)at   org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)     在org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)at   org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)     在   org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)     在   org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)     在java.lang.Thread.run(Thread.java:745)at   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher $ 1.run(MapReduceLauncher.java:276)   2016-09-17 15:44:03,952 [主要] INFO   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 0%完成2016-09-17 15:44:03,955 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 哎呀!有些工作失败了!如果希望Pig在失败时立即停止,请指定-stop_on_failure。 2016-09-17 15:44:03,955 [主要]信息   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 作业null失败了!停止运行所有依赖的工作2016-09-17 15:44:03,955 [主要]信息   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 100%完成2016-09-17 15:44:03,958 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce   工作失败了! 2016-09-17 15:44:03,958 [主要] INFO   org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - 脚本   统计数据:

     

HadoopVersion PigVersion UserId StartedAt FinishedAt功能   2.6.0 0.16.0 hadoop 2016-09-17 15:44:03 2016-09-17 15:44:03 UNKNOWN

     

失败!

     

失败的工作:JobId别名功能消息输出   N / A气候MAP_ONLY消息:发生意外的系统错误:   java.lang.IncompatibleClassChangeError:找到的接口   org.apache.hadoop.mapreduce.JobContext,但是期望上课   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:243)     在   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:191)     在   org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562)     在   org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)     在org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1296)at at   org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1293)at at   java.security.AccessController.doPrivileged(Native Method)at   javax.security.auth.Subject.doAs(Subject.java:422)at   org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)     在org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)at   org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)     在   org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)     在   org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)     在java.lang.Thread.run(Thread.java:745)at   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher $ 1.run(MapReduceLauncher.java:276)     文件:/ TMP / TEMP-927714196 / TMP-434253511,

     

输入:无法从" /home/MOCK_DATA.csv"

读取数据      

输出:无法生成结果   "文件:/ TMP / TEMP-927714196 / TMP-434253511"

     

计数器:写入的总记录数:0写入的总字节数:0可溢出   内存管理器泄漏计数:0主动溢出的行李总数:0总计   主动泄漏的记录:0

     

Job DAG:null

     

2016-09-17 15:44:03,962 [主要] INFO   org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher    - 失败了! 2016-09-17 15:44:03,963 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1066:无法打开迭代器   for alias climate at logfile的详细信息:   /home/hadoop/pig_1474106148648.log

0 个答案:

没有答案