当Spark使用Spray提交时,akka.jvm-exit-on-fatal-error

时间:2016-02-14 02:33:06

标签: apache-spark spray

不知道有没有人知道为什么我会通过一个非常基本的休息服务来打印火花上下文版本。我可以在IDE上本地运行它,但是当放在服务器上时,会发生异常

使用sbt程序集使用sbt 13.5构建的jar Spark版本:1.5.0-cdh5.5.0版 scala版本:2.10.4(尝试过2.11.7) 喷雾:1.3.3

command: spark-submit  --class com.thor.rest.Boot Spark-Scala-assembly-1.0.jar --master local

错误:

[ERROR] [02/13/2016 20:31:17.882] [spark-services-akka.actor.default-dispatcher-3] [ActorSystem(spark-services)] Uncaught error from thread [spark-services-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled
    java.lang.AbstractMethodError: spray.can.HttpManager.akka$actor$ActorLogging$_setter_$log_$eq(Lakka/event/LoggingAdapter;)V
            at akka.actor.ActorLogging$class.$init$(Actor.scala:335)
            at spray.can.HttpManager.<init>(HttpManager.scala:29)
            at spray.can.HttpExt$$anonfun$1.apply(Http.scala:153)
            at spray.can.HttpExt$$anonfun$1.apply(Http.scala:153)
            at akka.actor.TypedCreatorFunctionConsumer.produce(Props.scala:401)
            at akka.actor.Props.newActor(Props.scala:339)
            at akka.actor.ActorCell.newActor(ActorCell.scala:534)
            at akka.actor.ActorCell.create(ActorCell.scala:560)
            at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:425)
            at akka.actor.ActorCell.systemInvoke(ActorCell.scala:447)
            at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:262)
            at akka.dispatch.Mailbox.run(Mailbox.scala:218)
            at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
            at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
            at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
            at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
            at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

0 个答案:

没有答案