异常在群集上运行spark应用程序时初始化

时间:2017-08-31 10:03:35

标签: java apache-spark guava sbt-assembly

我试图在我的群集上运行我的spark应用程序,该群集由两个从属服务器和一个主服务器组成。当我使用sbt-assembly创建的.jar运行main时,出现以下错误:

Exception in thread "main" java.lang.ExceptionInInitializerError
at com.datastax.driver.core.Cluster.<clinit>(Cluster.java:68)
at com.outworkers.phantom.connectors.DefaultSessionProvider.<init>
(DefaultSessionProvider.scala:41)
at com.outworkers.phantom.connectors.CassandraConnection.provider$lzycompute(CassandraConnection.scala:41)
at com.outworkers.phantom.connectors.CassandraConnection.provider(CassandraConnection.scala:41)
at com.outworkers.phantom.connectors.CassandraConnection.session$lzycompute(CassandraConnection.scala:52)
at com.outworkers.phantom.connectors.CassandraConnection.session(CassandraConnection.scala:52)
at com.outworkers.phantom.database.Database.session$lzycompute(Database.scala:38)
at com.outworkers.phantom.database.Database.session(Database.scala:38)
at com.outworkers.phantom.database.Database.createAsync(Database.scala:85)
at com.outworkers.phantom.database.Database.create(Database.scala:75)
at Main$.main(Mainlearning.scala:20)
at Main.main(Mainlearning.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:187)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:212)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: com.datastax.driver.core.exceptions.DriverInternalError: Detected 
incompatible version of Guava in the classpath. You need 16.0.1 or higher.
at 

com.datastax.driver.core.GuavaCompatibility.selectImplementation(GuavaCompatibility.java:138)     在com.datastax.driver.core.GuavaCompatibility。    (GuavaCompatibility.java:52)

谢谢你。

编辑:在互联网上搜索回复时。我发现火花/罐子里的番石榴版本是14.0,我的超级罐子里的番石榴版本是19.0。以下错误要求在16.0版本的番石榴优越。我的问题是如何强制火花从我的超级罐中选择番石榴图书馆而不是火花目录罐中的版本。

0 个答案:

没有答案