Spark错误:org.apache.spark.SparkException:无法获得broadcast_4

时间:2017-01-17 12:53:31

标签: scala apache-spark apache-spark-sql spark-dataframe

我在提交点火作业时遇到以下错误:Caused by: org.apache.spark.SparkException: Failed to get broadcast_4_piece0 of broadcast_4

任何人都可以帮助我吗?

请参阅以下完整错误:

  

java.io.IOException:org.apache.spark.SparkException:无法获取   broadcast_4的broadcast_4_piece0

     

at org.apache.spark.util.Utils $ .tryOrIOException(Utils.scala:1178)

     

在   org.apache.spark.broadcast.TorrentBroadcast.readBroadcastBlock(TorrentBroadcast.scala:165)

     

在   org.apache.spark.broadcast.TorrentBroadcast._value $ lzycompute(TorrentBroadcast.scala:64)

     

在   org.apache.spark.broadcast.TorrentBroadcast._value(TorrentBroadcast.scala:64)

     

在   org.apache.spark.broadcast.TorrentBroadcast.getValue(TorrentBroadcast.scala:88)

     

at org.apache.spark.broadcast.Broadcast.value(Broadcast.scala:70)

     

在   org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:65)

     

在   org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)

     

at org.apache.spark.scheduler.Task.run(Task.scala:88)

     

在   org.apache.spark.executor.Executor $ TaskRunner.run(Executor.scala:214)

     

在   java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

     

在   java.util.concurrent.ThreadPoolExecutor中$ Worker.run(ThreadPoolExecutor.java:615)

     

在java.lang.Thread.run(Thread.java:745)

     

引起:org.apache.spark.SparkException:无法获取   broadcast_4的broadcast_4_piece0

0 个答案:

没有答案