Hadoop MapReduce作业挂起0%映射

时间:2014-12-10 01:19:38

标签: hadoop mapreduce

此问题已经被问到here,但没有提供任何答案,所以我再次提问。

我试图在hadoop上运行mapreduce作业,我之前没有遇到任何问题,但是从今天开始每次尝试运行它都会挂起0%。作业没有退出或失败,所有任务仍然未决。我还没有在日志中找到任何有用的东西,一切似乎都很正常。有什么建议吗?

14/12/10 01:08:01 INFO gcs.GoogleHadoopFileSystemBase: GHFS version: 1.3.0-hadoop1
packageJobJar: [/home/USER/gvcf-mapper.py, /hadoop/tmp/hadoop-unjar6643916888594909673/] []        /tmp/streamjob7416644368405402101.jar tmpDir=null
14/12/10 01:08:05 WARN snappy.LoadSnappy: Snappy native library is available
14/12/10 01:08:05 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/12/10 01:08:05 INFO snappy.LoadSnappy: Snappy native library loaded
14/12/10 01:08:27 INFO mapred.FileInputFormat: Total input paths to process : 15
14/12/10 01:08:31 INFO streaming.StreamJob: getLocalDirs(): [/hadoop/mapred/local]
14/12/10 01:08:31 INFO streaming.StreamJob: Running job: job_201412092247_0004
14/12/10 01:08:31 INFO streaming.StreamJob: To kill this job, run:
14/12/10 01:08:31 INFO streaming.StreamJob: /home/hadoop/hadoop-install/libexec/../bin/hadoop job  -Dmapred.job.tracker=hadoop-m:9101 -kill job_201412092247_0004
14/12/10 01:08:31 INFO streaming.StreamJob: Tracking URL: http://hadoop-m.c.PROJECT_NAME.internal:50030/jobdetails.jsp?jobid=job_201412092247_0004
14/12/10 01:08:32 INFO streaming.StreamJob:  map 0%  reduce 0%    

Tracking URL

0 个答案:

没有答案