我的问题是我不能再使用sbt-assembly插件了,因为在这个项目的几个人之间徘徊了某种依赖性合并问题。
我跑步时遇到的问题' :
[错误]合并期间遇到3个错误 java.lang.RuntimeException:deduplicate:找到不同的文件内容 在下面的: /Users/aris.vlasakakis/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.1.2.jar:org/slf4j/impl/StaticLoggerBinder.class /Users/aris.vlasakakis/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.6.1.jar:org/slf4j/impl/StaticLoggerBinder.class 重复数据删除:在以下内容中找到不同的文件内容: /Users/aris.vlasakakis/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.1.2.jar:org/slf4j/impl/StaticMDCBinder.class /Users/aris.vlasakakis/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.6.1.jar:org/slf4j/impl/StaticMDCBinder.class 重复数据删除:在以下内容中找到不同的文件内容: /Users/aris.vlasakakis/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.1.2.jar:org/slf4j/impl/StaticMarkerBinder.class /Users/aris.vlasakakis/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.6.1.jar:org/slf4j/impl/StaticMarkerBinder.class at sbtassembly.Assembly $ .applyStrategies(Assembly.scala:140) at sbtassembly.Assembly $ .x $ 1 $ lzycompute $ 1(Assembly.scala:25) at sbtassembly.Assembly $ .x $ 1 $ 1(Assembly.scala:23) at sbtassembly.Assembly $ .stratMapping $ lzycompute $ 1(Assembly.scala:23) at sbtassembly.Assembly $ .stratMapping $ 1(Assembly.scala:23) at sbtassembly.Assembly $ .inputs $ lzycompute $ 1(Assembly.scala:67) 在sbtassembly.Assembly $ .inputs $ 1(Assembly.scala:57)
......等等
I am using SBT-assembly 0.13.0, and here is the build.sbt
name := "metamorphosis"
version := "0.10.0"
scalaVersion := "2.10.4"
lazy val common = RootProject(file("../"))
val main = Project(id = "bridge", base = file(".")).dependsOn(common)
//excludeDependencies += "org.apache.logging.log4j"
resolvers ++= Seq(
// "Akka Snapshot Repository" at "http://repo.akka.io/snapshots/",
"Typesafe Releases" at "http://repo.typesafe.com/typesafe/releases/",
"Sonatype OSS Releases" at "http://oss.sonatype.org/content/repositories/releases/"
)
libraryDependencies ++= Seq(
"com.github.nscala-time" %% "nscala-time" % "1.8.0",
"com.sclasen" %% "akka-kafka" % "0.0.10" % "compile",
"com.typesafe.akka" %% "akka-actor" % "2.3.2",
"org.codehaus.groovy" % "groovy" % "2.3.7",
"com.typesafe.scala-logging" %% "scala-logging-slf4j" % "2.1.2",
"ch.qos.logback" % "logback-classic" % "1.1.2",
"ch.qos.logback.contrib" % "logback-json-classic" % "0.1.2",
"ch.qos.logback.contrib" % "logback-jackson" % "0.1.2",
"org.slf4j" % "slf4j-api" % "1.7.7",
"com.fasterxml.jackson.core" % "jackson-databind" % "2.2.2",
"org.clapper" %% "argot" % "1.0.3",
"com.typesafe" % "config" % "1.2.1",
"net.ceedubs" %% "ficus" % "1.0.1",
"com.typesafe.play" %% "anorm" % "2.3.6",
"org.json4s" %% "json4s-native" % "3.2.10",
"org.json4s" %% "json4s-jackson" % "3.2.10",
"com.github.tototoshi" %% "scala-csv" % "1.1.2",
"org.scalatest" %% "scalatest" % "2.2.2",
"junit" % "junit" % "4.11",
"org.apache.kafka" %% "kafka" % "0.8.1.1"
exclude("javax.jms", "jms")
exclude("com.sun.jdmk", "jmxtools")
exclude("com.sun.jmx", "jmxri")
exclude("org.slf4j", "slf4j-simple")
)
mainClass in assembly := Some("com.company.kafka.agent.MetamorphosisActor")
有关如何解决如何修复此合并问题的任何线索?
谢谢!
答案 0 :(得分:7)
问题是多个依赖项会导致slf4j
传递依赖,从而导致冲突。最好的方法是排除传递依赖,而不是使用SBT程序集的合并策略来解决冲突。
首先,您需要可视化slf4j的来源(适用于所有顶级依赖项)。您可以使用此sbt-dependency-graph之类的工具来获取所有依赖项的可视化图表。或者,您可以从SBT命令提示符中浏览SBT设置,或使用this one或this one等maven站点。
找到重复的依赖项后,使用exclude
的方式与在构建文件中使用的方式相同。只留下单slf4j
个传递依赖。您还可以排除所有slf4j
传递依赖项(请参阅here如何),并在顶层手动添加slf4j
依赖项。
请注意,如果您的依赖项需要多个不同版本的slf4j
,那么选择适用于所有情况的单个版本可能会有问题。取决于二进制兼容性。
答案 1 :(得分:6)
我的错误:
[error] (project/*:assembly) deduplicate: different file contents found in the following:
[error] /home/user/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.2.3.jar:org/slf4j/impl/StaticLoggerBinder.class
[error] /home/user/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticLoggerBinder.class
[error] deduplicate: different file contents found in the following:
[error] /home/user/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.2.3.jar:org/slf4j/impl/StaticMDCBinder.class
[error] /home/user/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticMDCBinder.class
[error] deduplicate: different file contents found in the following:
[error] /home/user/.ivy2/cache/ch.qos.logback/logback-classic/jars/logback-classic-1.2.3.jar:org/slf4j/impl/StaticMarkerBinder.class
[error] /home/user/.ivy2/cache/org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticMarkerBinder.class
追踪冲突的依赖关系。例如,我不想要那些类:
org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticLoggerBinder.class
org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticMDCBinder.class
org.slf4j/slf4j-log4j12/jars/slf4j-log4j12-1.7.10.jar:org/slf4j/impl/StaticMarkerBinder.class
致电sbt
(并确保使用sbt-dependency-graph插件):
whatDependsOn org.slf4j slf4j-log4j12 1.7.10
返回一个列表:
[info] org.slf4j:slf4j-log4j12:1.7.10
[info] +-org.apache.hadoop:hadoop-auth:2.8.0
[info] | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +-com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.zookeeper:zookeeper:3.4.6
[info] +-org.apache.curator:curator-client:2.7.1
[info] | +-org.apache.curator:curator-framework:2.7.1
[info] | | +-org.apache.curator:curator-recipes:2.7.1
[info] | | | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | | | +-com.github.atais:test_2.11:0.0.3 [S]
[info] | | |
[info] | | +-org.apache.hadoop:hadoop-auth:2.8.0
[info] | | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | | +-com.github.atais:test_2.11:0.0.3 [S]
[info] | |
[info] | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +-com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.curator:curator-framework:2.7.1
[info] | +-org.apache.curator:curator-recipes:2.7.1
[info] | | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | | +-com.github.atais:test_2.11:0.0.3 [S]
[info] | |
[info] | +-org.apache.hadoop:hadoop-auth:2.8.0
[info] | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +-com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.curator:curator-recipes:2.7.1
[info] | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +-com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.hadoop:hadoop-auth:2.8.0
[info] | +-org.apache.hadoop:hadoop-common:2.8.0
[info] | +-com.github.atais:test_2.11:0.0.3 [S]
[info] |
[info] +-org.apache.hadoop:hadoop-common:2.8.0
[info] +-com.github.atais:test_2.11:0.0.3 [S]
我需要追踪hadoop-common
依赖关系,因为它是将com.github.atais:test_2.11:0.0.3
与不受欢迎的org.slf4j:slf4j-log4j12:1.7.10
连接的
并修改它:
libraryDependencies += "org.apache.hadoop" % "hadoop-common" % "2.8.1" exclude("org.slf4j", "slf4j-log4j12")
只需为冲突路径添加合并策略标志:
assemblyMergeStrategy in assembly := {
...
case PathList("org", "slf4j", xs@_*) => MergeStrategy.first
case x => (assemblyMergeStrategy in assembly).value(x)
}