我已在hive-env.sh中将HADOOP_HEAPSIZE
配置为12288m,但仍然遇到OOM异常,我不得不经常重启hiveserver2 !!
当我在hiveserver上执行ps grep时,
mapr 4824 1 0 Apr05 ? 00:00:53 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.131.x86_64/bin/java -Xmx12288m -Dhiveserver2.auth=NONE -Dhadoop.login=simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dmapr.library.flatclass -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/opt/mapr/hadoop/hadoop-2.7.0/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/opt/mapr/hadoop/hadoop-2.7.0 -Dhadoop.id.str=mapr -Dhadoop.root.logger=INFO,console -Djava.library.path=/opt/mapr/hadoop/hadoop-2.7.0/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx512m -Dhadoop.security.logger=INFO,NullAppender -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider org.apache.hadoop.util.RunJar /opt/mapr/hive/hive-1.2/lib/hive-service-1.2.0-mapr-1603.jar org.apache.hive.service.server.HiveServer2
mapr 17943 1 0 Apr03 ? 00:03:13 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.131.x86_64/bin/java -Xmx256m -Dhiveserver2.auth=NONE -Dhadoop.login=simple -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider -Dmapr.library.flatclass -Djava.net.preferIPv4Stack=true -Dhadoop.log.dir=/opt/mapr/hadoop/hadoop-2.7.0/logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/opt/mapr/hadoop/hadoop-2.7.0 -Dhadoop.id.str=mapr -Dhadoop.root.logger=INFO,console -Djava.library.path=/opt/mapr/hadoop/hadoop-2.7.0/lib/native -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true -Xmx512m -Dhadoop.security.logger=INFO,NullAppender -Djava.security.auth.login.config=/opt/mapr/conf/mapr.login.conf -Dzookeeper.sasl.clientconfig=Client_simple -Dzookeeper.saslprovider=com.mapr.security.simplesasl.SimpleSaslProvider org.apache.hadoop.util.RunJar /opt/mapr/hive/hive-1.2/lib/hive-service-1.2.0-mapr-1603.jar org.apache.hadoop.hive.metastore.HiveMetaStore
mapr 27048 25765 0 09:16 pts/1 00:00:00 grep -i hiveserver2
似乎JVM将最右边的参数实例视为胜利者,因此在我的情况下,Xmx的最右边值是512m。
如何解决这个问题?