纱线MapReduce停留在ACCEPTED状态:等待AM容器分配,启动并注册RM

时间:2017-06-15 17:09:29

标签: mapreduce yarn hadoop2

您好我是Hadoop的新手,并尝试在我的本地计算机上以伪群集模式运行mapreduce。但每次我提交一份工作时,都会陷入

YarnApplicationState:   ACCEPTED: waiting for AM container to be allocated, launched and register with RM.

以下是我的配置文件:

纱-site.xml中

<property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
</property>
<property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
    <name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
    <value>1.0</value>
</property>
<property>
    <name>yarn.resourcemanager.scheduler.class</name>
 <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value>
</property>
<property>
    <name>yarn.scheduler.minimum-allocation-mb</name>
    <value>3000</value>
</property>
<property>
    <name>yarn.scheduler.maximum-allocation-mb</name>
    <value>7000</value>
</property>
<property>
    <name>yarn.nodemanager.resource.memory-mb</name>
    <value>10000</value>
</property>
<property>
    <name>yarn.resourcemanager.address</name>
    <value>127.0.0.1:8032</value>
</property>
<property>
    <name>yarn.resourcemanager.scheduler.address</name>
    <value>127.0.0.1:8030</value>
</property>
<property>
    <name>yarn.resourcemanager.resource-tracker.address</name>
    <value>127.0.0.1:8031</value>
</property>

maperd-site.xml中

<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
</property>
<property>
  <name>mapred.job.tracker</name>
  <value>localhost:54311</value>
 </property>
<property>
    <name>mapreduce.map.memory.mb</name>
    <value>2048</value>
</property>
<property>
    <name>mapreduce.reduce.memory.mb</name>
    <value>3072</value>
</property>

我的配置中的DFS复制是1,并且尝试一次只运行1个作业,但是这也等待了AM。 jps让我所有的守护得很好:

a45e60ebc96f:hadoop-2.7.3 z002ksm$ jps
27345 NodeManager
27907 Jps
27141 SecondaryNameNode
4485 
27258 ResourceManager
26958 NameNode
13615 GradleDaemon
27039 DataNode

以下是群集用户界面的屏幕截图:Hadoop UIHadoop UI

0 个答案:

没有答案