Question

我在YARN群集中运行MapReduce作业时遇到以下错误：

Application application_1394582929977_164223 failed 2 times 
due to AM Container for appattempt_1394582929977_164223_000002 exited with exitCode: 143 
due to: Container [pid=28402,containerID=container_1394582929977_164223_02_000001] is running beyond virtual memory limits. 
Current usage: 2.5 GB of 5 GB physical memory used; 10.5 GB of 10.5 GB virtual memory used. 
Killing container.

使用2.5 GB的5 GB物理内存。但是，所有虚拟内存都会被使用。如何覆盖虚拟内存设置，为我的工作增加它或分析我的工作以找出为什么需要这么多虚拟内存？

Answer 1

搜索 yarn.nodemanager.vmem-PMEM比启用yarn.nodemanager.vmem检查-

map-reduce作业失败，虚拟内存超出了Yarn集群的限制

1 个答案: