我正在尝试使用Spark流Twitter数据。我正在使用SBT,花了很多时间来解决此问题,但无济于事。
有人可以帮助我吗?这就是我的build.sbt
的样子:
name := "learning-spark-mini-example"
version := "0.0.1"
scalaVersion := "2.11.8"
libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.1.1"
// additional libraries
libraryDependencies ++= Seq(
"org.apache.spark" %% "spark-core" % "2.1.1" % "provided"
)
libraryDependencies += "org.apache.spark" %% "spark-streaming" % "2.1.1" % "provided"
libraryDependencies += "org.twitter4j" % "twitter4j-core" % "4.0.4"
libraryDependencies += "org.twitter4j" % "twitter4j-stream" % "4.0.4"
我已介绍了已解决的问题,但并没有帮助我。如果有人澄清这一点,那将是很大的帮助。