请帮助我理解Hive上下文中512mb(粗体大小)的内容是什么?
它的内存大小是多少?
我在export HADOOP_HEAPSIZE=4192
文件中设置了hive-site.xml
hadoop@master:~/hive/conf$ ps -ef | grep 'hive'
hadoop 5587 1 0 2014年2月? 00:05:27 / usr / lib / jvm / default-jdk / bin / java -Xmx4192m -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop.log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop -2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = / home / hadoop / hadoop-2.7.3 / lib / native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dhadoop.security.logger = INFO,NullAppender org.apache.hadoop.util.RunJar /home/hadoop/hive/lib/hive-metastore-2.3.2.jar org.apache.hadoop.hive.metastore.HiveMetaStore
hadoop 9903 8034 0 10:54 pts / 0 00:00:00 grep --color = auto hive
hadoop 21646 15918 1 07:37 pts / 3 00:03:02 / usr / lib / jvm / default-jdk / bin / java -Xmx4192m -Djava.net.preferIPv4Stack = true -Dhadoop.log.dir = / home / hadoop / hadoop-2.7.3 / logs -Dhadoop.log.file = hadoop.log -Dhadoop.home.dir = / home / hadoop / hadoop -2.7.3 -Dhadoop.id.str = hadoop -Dhadoop.root.logger = INFO,console -Djava.library.path = / home / hadoop / hadoop-2.7.3 / lib / native -Dhadoop.policy.file = hadoop-policy.xml -Djava.net.preferIPv4Stack = true -Xmx512m -Dproc_hivecli -Dlog4j.configurationFile = hive-log4j2.properties -Djava.util.logging.config.file = / home / hadoop /蜂房/ CONF / parquet-logging.properties -Dhadoop.security.logger = INFO,NullAppender org.apache.hadoop.util.RunJar /home/hadoop/hive/lib/hive-cli-2.3.2.jar org.apache.hadoop.hive.cli.CliDriver
答案 0 :(得分:1)
您编辑的变量适用于客户端,而不是服务器,并且您不会从XML文件中导出任何内容
要配置HiveServer2和Hive Metastore的堆大小,请将
中所需的最大堆大小HADOOP_OPTS
变量中的-Xmx参数设置为/etc/hive/hive-env.sh
VS
要配置Beeline CLI的堆大小,请在
中设置HADOOP_HEAPSIZE
/etc/hive/hive-env.sh
环境变量
除此之外,这两个值都是如此,所以你可能想看看
Duplicated Java runtime options : what is the order of preference?