容器[xxx]运行超出“物理”内存限制

时间:2019-02-21 12:46:27

标签: hive sqoop hortonworks-data-platform ubuntu-18.04 ambari

使用通过Ambari 2.7.3.0(hortonworks DP)安装的hive2构建基本数据仓库。我选择的服务是:HDFSYARN + MapReduce2TezHivePigSqoopOozie,{{ 1}},Zookeeper(Ambari强迫我选择了最后2个)

所有这些服务都在一个AWS ec2实例t2.xlarge(4vCPU,16Gb RAM)中运行。

问题是仅从远程MySQL数据库表中提取10行失败,并显示以下错误:

Ambari Metrics & SmartSense

考虑我是Ambari和Hortonworks的新手

我遵循Ambari向导进行安装,但没有进行任何更改,这是运行基本Sqoop-Hive命令项目(但不限于此)所需要的:

  1. 配置调整
  2. 所需资源

更新

命令运行为

19/02/21 12:14:16 INFO mapreduce.Job: Running job: job_1550749363487_0002
19/02/21 12:14:23 INFO mapreduce.Job: Job job_1550749363487_0002 running in uber mode : false
19/02/21 12:14:23 INFO mapreduce.Job:  map 0% reduce 0%
19/02/21 12:14:34 INFO mapreduce.Job: Job job_1550749363487_0002 failed with state FAILED due to: Application application_1550749363487_0002 failed 2 times due to AM Container for appattempt_1550749363487_0002_000002 exited with  exitCode: -104
Failing this attempt.Diagnostics: [2019-02-21 12:14:34.012]Container [pid=9602,containerID=container_e05_1550749363487_0002_02_000001] is running 78503936B beyond the 'PHYSICAL' memory limit. Current usage: 244.9 MB of 170 MB physical memory used; 1.8 GB of 357.0 MB virtual memory used. Killing container.

0 个答案:

没有答案