您好我是Hadoop的新手,并尝试在我的本地计算机上以伪群集模式运行mapreduce。但每次我提交一份工作时,都会陷入
YarnApplicationState: ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
以下是我的配置文件:
纱-site.xml中
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
<value>1.0</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>3000</value>
</property>
<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>7000</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>10000</value>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>127.0.0.1:8032</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>127.0.0.1:8030</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>127.0.0.1:8031</value>
</property>
maperd-site.xml中
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>localhost:54311</value>
</property>
<property>
<name>mapreduce.map.memory.mb</name>
<value>2048</value>
</property>
<property>
<name>mapreduce.reduce.memory.mb</name>
<value>3072</value>
</property>
我的配置中的DFS复制是1,并且尝试一次只运行1个作业,但是这也等待了AM。 jps让我所有的守护得很好:
a45e60ebc96f:hadoop-2.7.3 z002ksm$ jps
27345 NodeManager
27907 Jps
27141 SecondaryNameNode
4485
27258 ResourceManager
26958 NameNode
13615 GradleDaemon
27039 DataNode