hadoop mapreduce工作卡在地图上0%减少0%

时间:2016-09-29 06:12:46

标签: mapreduce yarn hadoop2

在单节点集群上安装hadoop设置文档后,我安装了hadoop,然后当我尝试运行其中一个示例hadoop-mapreduce-examples-2.7.3.jar时,该过程似乎陷入了映射0%reduce 0%在running州。 我的系统规格是1TB物理内存,8GB RAM,4核。

mapred-site.xml是:

<property>
 <name>yarn.nodemanager.resource.memory-mb</name>
 <value>2000</value>
</property>
<property>
 <name>yarn.scheduler.minimum-allocation-mb</name>
 <value>500</value>
</property>
<property>
 <name>yarn.scheduler.maximum-allocation-mb</name>
 <value>2500</value>
</property>
<property>
 <name>yarn.scheduler.maximum-allocation-vcores</name>
 <value>3</value>
 <source>yarn-default.xml</source>
</property>

yarn-site.xml

<property>
 <name>mapreduce.map.memory.mb</name>
 <value>1000</value>
</property>
<property>
 <name>mapreduce.reduce.memory.mb</name>
 <value>1000</value>
</property>
<property>
 <name>mapreduce.map.java.opts</name>
 <value>-Xmx800m</value>
</property>
<property>
 <name>mapreduce.reduce.java.opts</name>
 <value>-Xmx800m</value>
</property>

控制台日志:

16/09/30 11:38:08 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/09/30 11:38:10 INFO input.FileInputFormat: Total input paths to process : 0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: number of splits:0
16/09/30 11:38:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1475215403708_0001
16/09/30 11:38:12 INFO impl.YarnClientImpl: Submitted application application_1475215403708_0001
16/09/30 11:38:12 INFO mapreduce.Job: The url to track the job: http://DeadSilence:8088/proxy/application_1475215403708_0001/
16/09/30 11:38:12 INFO mapreduce.Job: Running job: job_1475215403708_0001 
16/09/30 11:38:23 INFO mapreduce.Job: Job job_1475215403708_0001 running in uber mode : false
16/09/30 11:38:23 INFO mapreduce.Job:  map 0% reduce 0%

0 个答案:

没有答案