Mapreduce任务无止境

时间:2017-06-20 08:00:00

标签: hadoop mapreduce

我在ubuntu 14.04上使用Hadoop 2.6.0。 它是一个单一节点,即我的笔记本电脑。 我正在研究wordcount示例。一切似乎都很好,除了map-reduce任务永远不会结束。 这是日志

hadoop jar wc.jar WordCount /home/hduser/wc/input/ /home/hduser/wc/op1
17/06/20 13:23:25 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
17/06/20 13:23:29 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
17/06/20 13:23:29 WARN mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
17/06/20 13:23:30 INFO input.FileInputFormat: Total input paths to process : 2
17/06/20 13:23:34 INFO mapreduce.JobSubmitter: number of splits:2
17/06/20 13:23:36 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1497883090952_0004
17/06/20 13:23:37 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
17/06/20 13:23:38 INFO impl.YarnClientImpl: Submitted application application_1497883090952_0004
17/06/20 13:23:39 INFO mapreduce.Job: The url to track the job: http://chaitannya-HP-2000-Notebook-PC:8088/proxy/application_1497883090952_0004/
17/06/20 13:23:39 INFO mapreduce.Job: Running job: job_1497883090952_0004

我检查了是否有任何待处理的工作,所以没有。

 mapred job -list
17/06/20 13:28:57 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
Total jobs:1
                  JobId      State       StartTime      UserName           Queue      Priority   UsedContainers  RsvdContainers  UsedMem     RsvdMem     NeededMem     AM info
 job_1497883090952_0004       PREP   1497945217680        hduser         default        NORMAL                0               0       0M          0M            0M  

可能是什么问题。

0 个答案:

没有答案