使用通过Ambari 2.7.3.0(hortonworks DP)安装的hive2构建基本数据仓库。我选择的服务是:HDFS
,YARN + MapReduce2
,Tez
,Hive
,Pig
,Sqoop
,Oozie
,{{ 1}},Zookeeper
(Ambari强迫我选择了最后2个)
所有这些服务都在一个AWS ec2实例t2.xlarge(4vCPU,16Gb RAM)中运行。
问题是仅从远程MySQL数据库表中提取10行失败,并显示以下错误:
Ambari Metrics & SmartSense
考虑我是Ambari和Hortonworks的新手
我遵循Ambari向导进行安装,但没有进行任何更改,这是运行基本Sqoop-Hive命令项目(但不限于此)所需要的:
命令运行为
19/02/21 12:14:16 INFO mapreduce.Job: Running job: job_1550749363487_0002
19/02/21 12:14:23 INFO mapreduce.Job: Job job_1550749363487_0002 running in uber mode : false
19/02/21 12:14:23 INFO mapreduce.Job: map 0% reduce 0%
19/02/21 12:14:34 INFO mapreduce.Job: Job job_1550749363487_0002 failed with state FAILED due to: Application application_1550749363487_0002 failed 2 times due to AM Container for appattempt_1550749363487_0002_000002 exited with exitCode: -104
Failing this attempt.Diagnostics: [2019-02-21 12:14:34.012]Container [pid=9602,containerID=container_e05_1550749363487_0002_02_000001] is running 78503936B beyond the 'PHYSICAL' memory limit. Current usage: 244.9 MB of 170 MB physical memory used; 1.8 GB of 357.0 MB virtual memory used. Killing container.