Hive进程内存大小

时间:2018-02-15 11:03:48

标签: hadoop hive

请帮助我理解Hive上下文中512mb(粗体大小)的内容是什么? 它的内存大小是多少? 我在export HADOOP_HEAPSIZE=4192文件中设置了hive-site.xml

hadoop@master:~/hive/conf$ ps -ef | grep 'hive'

  

hadoop 5587 1 0 2014年2月? 00:05:27   / usr / lib / jvm / default-jdk / bin / java -Xmx4192m   -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop.log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop -2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = / home / hadoop / hadoop-2.7.3 / lib / native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dhadoop.security.logger = INFO,NullAppender org.apache.hadoop.util.RunJar   /home/hadoop/hive/lib/hive-metastore-2.3.2.jar   org.apache.hadoop.hive.metastore.HiveMetaStore

hadoop 9903 8034 0 10:54 pts / 0 00:00:00 grep --color = auto hive

  

hadoop 21646 15918 1 07:37 pts / 3 00:03:02   / usr / lib / jvm / default-jdk / bin / java -Xmx4192m   -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop.log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop -2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = / home / hadoop / hadoop-2.7.3 / lib / native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dproc_hivecli -Dlog4j.configurationFile = hive-log4j2.properties -Djava.util.logging.config.file = / home / hadoop /蜂房/ CONF / parquet-logging.properties   -Dhadoop.security.logger = INFO,NullAppender org.apache.hadoop.util.RunJar /home/hadoop/hive/lib/hive-cli-2.3.2.jar   org.apache.hadoop.hive.cli.CliDriver

1 个答案:

答案 0 :(得分:1)

您编辑的变量适用于客户端,而不是服务器,并且您不会从XML文件中导出任何内容

  

要配置HiveServer2和Hive Metastore的堆大小,请将HADOOP_OPTS变量中的-Xmx参数设置为/etc/hive/hive-env.sh

中所需的最大堆大小

VS

  

要配置Beeline CLI的堆大小,请在HADOOP_HEAPSIZE

中设置/etc/hive/hive-env.sh环境变量

除此之外,这两个值都是如此,所以你可能想看看

Duplicated Java runtime options : what is the order of preference?