运行spark作业时找不到jars / lib

时间:2018-09-18 18:18:20

标签: jar lib

运行spark作业时出现错误。请协助解决问题。

遇到此错误,请提供帮助:

TID 0,本地主机,执行程序驱动程序):java.lang.RuntimeException:找不到流“ / jars / lib”。

以下详细信息:

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在com.thinkbiganalytics.spark.repl.ScriptEngine .eval(ScriptEngine.java:161)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在com.thinkbiganalytics.spark.interpreter.App .main(App.java:94)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native方法)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl。 .java:62)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl .java:43)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7] at java.lang.reflect.Method.invoke (Method.java:498)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.deploy.SparkSubmit $ .org $ apache $ spark $ deploy $ SparkSubmit $$ runMain(SparkSubmit.scala:730)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.deploy.SparkSubmit $ .doRunMain $ 1(SparkSubmit.scala:181)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.deploy.SparkSubmit $ .submit(SparkSubmit.scala:206)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.deploy.SparkSubmit $ .main(SparkSubmit.scala:121)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.deploy.SparkSubmit .main(SparkSubmit.scala)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]原因:org.apache.spark.SparkException :作业由于阶段失败而中止:阶段0中的任务0失败1次,最近一次失败:阶段0.0中的任务0.0丢失(TID 0,本地主机,执行器驱动程序):java.lang.RuntimeException:流'/ jars / lib'找不到。

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.network.client .TransportResponseHandler.handle(TransportResponseHandler.java:219)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.network.server .TransportChannelHandler.channelRead0(TransportChannelHandler.java:106)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在org.apache.spark.network.server .TransportChannelHandler.channelRead0(TransportChannelHandler.java:51)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.SimpleChannelInboundHandler.channelRead (SimpleChannelInboundHandler.java:105)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead (AbstractChannelHandlerContext.java:308)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.AbstractChannelHandlerContext.fireChannelRead (AbstractChannelHandlerContext.java:294)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.handler.timeout.IdleStateHandler .channelRead(IdleStateHandler.java:266)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead (AbstractChannelHandlerContext.java:308)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.AbstractChannelHandlerContext.fireChannelRead (AbstractChannelHandlerContext.java:294)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.handler.codec.MessageToMessageDecoder .channelRead(MessageToMessageDecoder.java:103)

2018-09-08 19:31:23,373信息[流错误] ctnifi.v2.spark.ExecuteSparkJob ExecuteSparkJob [id = d902e218-510e-39a9-fd79-6adc50bd92d7]在io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead (AbstractChannelHandlerContext.java:308)

2018-09-08 19:31:23,373信息[流错误

Th

0 个答案:

没有答案