climate = LOAD '/home/MOCK_DATA.csv' USING PigStorage(',');
DUMP climate;
我收到此错误。
2016-09-17 15:44:03,880 [main] INFO org.apache.pig.tools.pigstats.ScriptState - 使用的Pig功能 脚本:UNKNOWN 2016-09-17 15:44:03,910 [主要]信息 org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum已弃用。相反,使用 dfs.bytes-per-checksum 2016-09-17 15:44:03,910 [主要]信息 org.apache.hadoop.conf.Configuration.deprecation - fs.default.name是 弃用。相反,请使用fs.defaultFS 2016-09-17 15:44:03,910 [main] INFO org.apache.pig.data.SchemaTupleBackend - 键[pig.schematuple] 未设置...将不会生成代码。 2016-09-17 15:44:03,911 [主要] INFO org.apache.pig.newplan.logical.optimizer.LogicalPlanOptimizer - {RULES_ENABLED = [AddForEach,ColumnMapKeyPrune,ConstantCalculator, GroupByConstParallelSetter,LimitOptimizer,LoadTypeCastInserter, MergeFilter,MergeForEach,PartitionFilterOptimizer, PredicatePushdownOptimizer,PushDownForEachFlatten,PushUpFilter, SplitFilter,StreamTypeCastInserter]} 2016-09-17 15:44:03,911 [main] 信息 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - 文件级联阈值:100乐观? false 2016-09-17 15:44:03,913 [主要] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - 优化前的MR计划规模:1 2016-09-17 15:44:03,913 [主要]信息 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - 优化后的MR计划规模:1 2016-09-17 15:44:03,926 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum已弃用。相反,使用 dfs.bytes-per-checksum 2016-09-17 15:44:03,927 [主要]信息 org.apache.hadoop.conf.Configuration.deprecation - fs.default.name是 弃用。相反,请使用fs.defaultFS 2016-09-17 15:44:03,928 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - 无法初始化JVM processName = JobTracker,sessionId =已经初始化的度量标准 2016-09-17 15:44:03,929 [主要]信息 org.apache.pig.tools.pigstats.mapreduce.MRScriptState - Pig脚本 设置被添加到作业2016-09-17 15:44:03,929 [主要]信息 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent未设置,设置为默认值0.3 2016-09-17 15:44:03,932 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - 设置单店作业2016-09-17 15:44:03,940 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1个map-reduce等待提交的工作。 2016-09-17 15:44:03,949 [JobControl] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - 不能 使用processName = JobTracker初始化JVM指标,sessionId = - 已经初始化2016-09-17 15:44:03,950 [JobControl] ERROR org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl - 同时出错 试图运行工作。 java.lang.IncompatibleClassChangeError:找到了 接口org.apache.hadoop.mapreduce.JobContext,但是类是 预计在 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:243) 在 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:191) 在 org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562) 在 org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432) 在org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1296)at at org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1293)at at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) 在org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335) 在 org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240) 在 org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121) 在java.lang.Thread.run(Thread.java:745)at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher $ 1.run(MapReduceLauncher.java:276) 2016-09-17 15:44:03,952 [主要] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0%完成2016-09-17 15:44:03,955 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 哎呀!有些工作失败了!如果希望Pig在失败时立即停止,请指定-stop_on_failure。 2016-09-17 15:44:03,955 [主要]信息 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 作业null失败了!停止运行所有依赖的工作2016-09-17 15:44:03,955 [主要]信息 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100%完成2016-09-17 15:44:03,958 [main] ERROR org.apache.pig.tools.pigstats.mapreduce.MRPigStatsUtil - 1 map reduce 工作失败了! 2016-09-17 15:44:03,958 [主要] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - 脚本 统计数据:
HadoopVersion PigVersion UserId StartedAt FinishedAt功能 2.6.0 0.16.0 hadoop 2016-09-17 15:44:03 2016-09-17 15:44:03 UNKNOWN
失败!
失败的工作:JobId别名功能消息输出 N / A气候MAP_ONLY消息:发生意外的系统错误: java.lang.IncompatibleClassChangeError:找到的接口 org.apache.hadoop.mapreduce.JobContext,但是期望上课 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:243) 在 org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:191) 在 org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:562) 在 org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432) 在org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1296)at at org.apache.hadoop.mapreduce.Job $ 10.run(Job.java:1293)at at java.security.AccessController.doPrivileged(Native Method)at javax.security.auth.Subject.doAs(Subject.java:422)at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) 在org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335) 在 org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240) 在 org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121) 在java.lang.Thread.run(Thread.java:745)at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher $ 1.run(MapReduceLauncher.java:276) 文件:/ TMP / TEMP-927714196 / TMP-434253511,
输入:无法从" /home/MOCK_DATA.csv"
读取数据输出:无法生成结果 "文件:/ TMP / TEMP-927714196 / TMP-434253511"
计数器:写入的总记录数:0写入的总字节数:0可溢出 内存管理器泄漏计数:0主动溢出的行李总数:0总计 主动泄漏的记录:0
Job DAG:null
2016-09-17 15:44:03,962 [主要] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 失败了! 2016-09-17 15:44:03,963 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1066:无法打开迭代器 for alias climate at logfile的详细信息: /home/hadoop/pig_1474106148648.log