Hive:虽然使用JDK8,但AppClassLoader不能转换为URLClassLoader

时间:2017-12-20 01:40:16

标签: java hive classloader java-9 urlclassloader

安装jdk9后,我一直在看到这个问题:

$hive
Java HotSpot(TM) 64-Bit Server VM warning: Ignoring option MaxPermSize; support was removed in 8.0
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/Cellar/hive/2.3.1/libexec/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/Cellar/hadoop/2.8.1/libexec/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Exception in thread "main" java.lang.ClassCastException: java.base/jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to java.base/java.net.URLClassLoader
    at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:394)
    at org.apache.hadoop.hive.ql.session.SessionState.<init>(SessionState.java:370)
    at org.apache.hadoop.hive.cli.CliSessionState.<init>(CliSessionState.java:60)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:708)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:686)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.base/java.lang.reflect.Method.invoke(Method.java:564)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:234)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:148)

但我有

更新$PATH以指向java8

$java -version
java version "1.8.0_144"
Java(TM) SE Runtime Environment (build 1.8.0_144-b01)
Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode)

更新hive可执行文件以指定java8

vi $(which hive)

#!/bin/bash
JAVA_HOME="$(/usr/libexec/java_home --version 1.8)" HIVE_HOME="/usr/local/Cellar/hive/2.3.1/libexec" exec "/usr/local/Cellar/hive/2.3.1/libexec/bin/hive" "$@"

已验证更新的java版本确实指向jdk8

$/usr/libexec/java_home --version 1.8
/Library/Java/JavaVirtualMachines/jdk1.8.0_144.jdk/Contents/Home

我还应该在这里讨论什么?

这是hive 2.3.1

上的macos
 $hive --version
Hive 2.3.1
Git git://jcamachorodriguez-rMBP.local/Users/jcamachorodriguez/src/workspaces/hive/HIVE-apache/hive -r 7590572d9265e15286628013268b2ce785c6aa08
Compiled by jcamachorodriguez on Thu Oct 19 18:37:58 PDT 2017
From source with checksum 03c91029a6103bd91f25a6ff8a01fbcd

3 个答案:

答案 0 :(得分:2)

安装jdk8并在hadoop-env.sh中相应地更改路径,这对我有用。

答案 1 :(得分:0)

我遇到同样的问题,我只是删除了JDK 9而不是改变环境,问题就解决了。

请参阅hive,它使用

JAVA_HOME="$(/usr/libexec/java_home --version 1.7+)" 
HIVE_HOME="/usr/local/Cellar/hive/2.3.1/libexec" 
exec "/usr/local/Cellar/hive/2.3.1/libexec/bin/hive" "$@".

答案 2 :(得分:0)

设置蜂巢时我遇到了同样的错误,起初我认为这可能是由于Java版本不同所致。

但是在检查Java版本时,它是jdk 1.8。

最后在检查jdk安装目录(/ Library / Java / JavaVirtualMachine)时,我发现同时存在jdk 1.8和jdk 10

我删除了jdk 10,终于奏效了。