在线程“主”中获取异常java.lang.NoClassDefFoundError:Maven项目的org / spark_project / guava / cache / CacheLoader

时间:2018-09-29 20:40:05

标签: maven apache-spark apache-spark-sql

我确实在Maven项目中将Spark版本从2.2.2升级到2.3.2,但收到以下错误:

Exception in thread "main" java.lang.NoClassDefFoundError: org/spark_project/guava/cache/CacheLoader
    at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:75)
    at org.apache.spark.SparkConf.<init>(SparkConf.scala:70)
    at org.apache.spark.SparkConf.<init>(SparkConf.scala:57)

pom.xml文件包含以下依赖项:

    <dependency>
        <groupId>org.scala-lang</groupId>
        <artifactId>scala-library</artifactId>
        <version>2.11.12</version>
    </dependency>

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-core_2.11</artifactId>
        <version>2.3.2</version>
    </dependency>

    <dependency>
        <groupId>org.apache.spark</groupId>
        <artifactId>spark-sql_2.11</artifactId>
        <version>2.3.2</version>
    </dependency>

我应该添加哪些依赖关系以消除Spark 2.3.2的此问题?

0 个答案:

没有答案