我有一个Spark Ignite程序。当我使用sbt构建程序时,它报告错误。
这是一个非常简单的程序,它只是一个sbt文件的空项目。
build.sbt:
name := "testsss" version := "1.0" scalaVersion := "2.11.7" libraryDependencies += "org.apache.spark" %% "spark-core" % "2.1.0" libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.1.0" libraryDependencies += "org.apache.ignite" % "ignite-core" % "1.9.0" libraryDependencies += "org.apache.ignite" % "ignite-indexing" % "1.9.0" libraryDependencies += "org.apache.ignite" % "ignite-spark" % "1.9.0"
错误是
我检查了一下。似乎'"点燃 - 火花" %" 1.9.0"使用了spark-core和spark-sql的冲突依赖的不同版本。我怎么能解决这个问题?错误:导入SBT项目时出错:
...[info] Resolving org.scala-sbt#testing;0.13.8 ... [info] Resolving org.scala-sbt#test-agent;0.13.8 ... [info] Resolving org.scala-sbt#test-interface;1.0 ... [info] Resolving org.scala-sbt#main-settings;0.13.8 ... [info] Resolving org.scala-sbt#apply-macro;0.13.8 ... [info] Resolving org.scala-sbt#command;0.13.8 ... [info] Resolving org.scala-sbt#logic;0.13.8 ... [info] Resolving org.scala-sbt#precompiled-2_8_2;0.13.8 ... [info] Resolving org.scala-sbt#precompiled-2_9_2;0.13.8 ... [info] Resolving org.scala-sbt#precompiled-2_9_3;0.13.8 ... [error] Modules were resolved with conflicting cross-version suffixes in {file:/Users/lzhan71/Documents/IgniteMaster/}ignitemaster: [error]
org.scalatest:scalatest _2.11, _2.10 [error] com.twitter:chill _2.11, _2.10 [error] org.apache.spark:spark-unsafe _2.11, _2.10 [error] org.apache.spark:spark-tags _2.11, _2.10 [trace] Stack trace suppressed: run 'last *:update' for the full output. [trace] Stack trace suppressed: run 'last :ssExtractDependencies' for the full output. [error] (:update) Conflicting cross-version suffixes in: org.scalatest:scalatest, com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags [error] (*:ssExtractDependencies) Conflicting cross-version suffixes in: org.scalatest:scalatest, com.twitter:chill, org.apache.spark:spark-unsafe, org.apache.spark:spark-tags [error] Total time: 17 s, completed Apr 28, 2017 4:41:00 PM
参见 完成登录/Users/lzhan71/Library/Logs/IdeaIC2016.2/sbt.last.log
答案 0 :(得分:1)
这似乎是ignite-spark
中的错误。 spark-unsafe_2.10
和scala-library
2.11.8同时depends,这绝不会发生。报告并等待新版本发布或解决方法,获取其源代码,修复spark-unsafe_2.10
依赖项并重新编译(很可能不需要修改源代码)。
答案 1 :(得分:1)
您也可以尝试修复它: libraryDependencies + =" org.apache.ignite" %"点燃火花" %" 2.2.0" EXCLUDEALL(ExclusionRule(" org.apache.spark&#34))