Question

我运行配置单元命令行：

hive -hiveconf mapreduce.map.memory.mb=4096  -hiveconf mapreduce.reduce.memory.mb=5120  -e 'SET mapreduce.job.queuename=hive;SELECT city,app,dealid, creativeid, count(1) FROM log.adlog WHERE `date` between 20190501 and 20190630 AND campid in(281)  and logtype in (4,7,16)  GROUP BY city,app,dealid,creativeid'

我的hive-env.sh

#
 if [ "$SERVICE" = "cli" ]; then
   if [ -z "$DEBUG" ]; then
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -Xmx12288m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParNewGC -XX:-UseGCOverheadLimit"
   else
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -XX:PermSize=4096M -XX:MaxPermSize=8192M -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:-UseGCOverheadLimit"
   fi
 fi

# The heap size of the jvm stared by hive shell script can be controlled via:
#
export HADOOP_CLIENT_OPTS=" -Xmx6144m"
export HADOOP_HEAPSIZE=2048

返回结果，但有错误

1156310000  5   mg201904301019  1123    104
1156320600  5   mg201904301022  1100    130
Time taken: 407.079 seconds, Fetched: 405 row(s)
Exception in thread "main"
Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "main"

从线程“ main”中的UncaughtExceptionHandler抛出的java.lang.OutOfMemoryError

0 个答案: