我正在向YARN提交一个简单的wordcount应用程序。
我获得此申请状态 mounted: function(){
this.dataset = _.map(this.collection, function(element){
return Object.assign({}, element, {visible: true});
});
},
但是检查NodeManager日志表明实际上已经分配了一个容器。 这是NM日志的冗余行:(它还在Web UI上显示LAUNCHED容器)
ACCEPTED: waiting for AM container to be allocated, launched and register with RM.
这是我的Yarn-site.xml:
2018-02-02 21:34:52,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 4489 for container-id container_1517605293649_0003_02_02_000001: 249.6 MB of 2 GB physical memory used; 1.5 GB of 4.2 GB virtual memory used
我的mapred-site.xml
<configuration>
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>6144</value>
</property>
<property>
<name>yarn.nodemanager.vmem-check-enabled</name>
<value>false</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>vanillacluster-vanilla-default-master-0</value>
</property>
<property>
<name>yarn.resourcemanager.nodes.exclude-path</name>
<value>/opt/hadoop/etc/hadoop/nm-exclude</value>
</property>
<property>
<name>yarn.resourcemanager.nodes.include-path</name>
<value>/opt/hadoop/etc/hadoop/nm-include</value>
</property>
<property>
<name>yarn.scheduler.maximum-allocation-mb</name>
<value>6144</value>
</property>
<property>
<name>yarn.scheduler.minimum-allocation-mb</name>
<value>512</value>
</property>
</configuration>
我无法发现问题,因为我的可用内存至少比所需内存多两倍。
感谢您的帮助。