Apache Spark Maven POM错误

时间:2017-12-17 21:43:44

标签: java scala maven apache-spark intellij-idea

我正在尝试使用Apache Spark并遇到一些我遇到的问题。我有一个来自Apache Spark Github的JavaSparkHiveExample.java示例以及我在IntelliJ IDEA中创建的Maven项目的pom.xml

我可以运行其他Spark示例(使用另一个更简单的POM)但this one给出了以下错误:

enter image description here

  • Scala已安装在Idea

我是Maven的新手,因此我会感谢一些我可以尝试解决这个问题的事情。

1 个答案:

答案 0 :(得分:1)

Issue is with the value of $project.version. It is referring to your project' version (2.3.0-snapshot). There isn't any maven dependency with this version in Maven central repository, hence you are facing this issue. Instead of using the project version, you can add a new property like this and refer it for all dependency version

FirebaseRecyclerOptions

and then use it in the dependency

<properties>
 <spark.version>1.6.2</spark.version>
</properties>

Make sure the version you are using is available in maven repository https://mvnrepository.com/ enter image description here