org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl:ProcessTree的内存使用情况

时间:2018-02-02 21:49:55

标签: hadoop yarn

我正在向YARN提交一个简单的wordcount应用程序。

我获得此申请状态 mounted: function(){ this.dataset = _.map(this.collection, function(element){ return Object.assign({}, element, {visible: true}); }); },

但是检查NodeManager日志表明实际上已经分配了一个容器。 这是NM日志的冗余行:(它还在Web UI上显示LAUNCHED容器)

ACCEPTED: waiting for AM container to be allocated, launched and register with RM.

这是我的Yarn-site.xml:

   2018-02-02 21:34:52,981 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl: Memory usage of ProcessTree 4489 for container-id container_1517605293649_0003_02_02_000001: 249.6 MB of 2 GB physical memory used; 1.5 GB of 4.2 GB virtual memory used

我的mapred-site.xml

 <configuration>
  <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
  <property>
    <name>yarn.nodemanager.resource.memory-mb</name>
    <value>6144</value>
  </property>
  <property>
    <name>yarn.nodemanager.vmem-check-enabled</name>
    <value>false</value>
  </property>
  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>vanillacluster-vanilla-default-master-0</value>
  </property>
  <property>
    <name>yarn.resourcemanager.nodes.exclude-path</name>
    <value>/opt/hadoop/etc/hadoop/nm-exclude</value>
  </property>
  <property>
    <name>yarn.resourcemanager.nodes.include-path</name>
    <value>/opt/hadoop/etc/hadoop/nm-include</value>
  </property>
  <property>
    <name>yarn.scheduler.maximum-allocation-mb</name>
    <value>6144</value>
  </property>
  <property>
    <name>yarn.scheduler.minimum-allocation-mb</name>
    <value>512</value>
  </property>
</configuration>

我无法发现问题,因为我的可用内存至少比所需内存多两倍。

enter image description here

感谢您的帮助。

0 个答案:

没有答案