我在提交点火作业时遇到以下错误:Caused by: org.apache.spark.SparkException: Failed to get broadcast_4_piece0 of broadcast_4
任何人都可以帮助我吗?
请参阅以下完整错误:
java.io.IOException:org.apache.spark.SparkException:无法获取 broadcast_4的broadcast_4_piece0
at org.apache.spark.util.Utils $ .tryOrIOException(Utils.scala:1178)
在 org.apache.spark.broadcast.TorrentBroadcast.readBroadcastBlock(TorrentBroadcast.scala:165)
在 org.apache.spark.broadcast.TorrentBroadcast._value $ lzycompute(TorrentBroadcast.scala:64)
在 org.apache.spark.broadcast.TorrentBroadcast._value(TorrentBroadcast.scala:64)
在 org.apache.spark.broadcast.TorrentBroadcast.getValue(TorrentBroadcast.scala:88)
at org.apache.spark.broadcast.Broadcast.value(Broadcast.scala:70)
在 org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:65)
在 org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:88)
在 org.apache.spark.executor.Executor $ TaskRunner.run(Executor.scala:214)
在 java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
在 java.util.concurrent.ThreadPoolExecutor中$ Worker.run(ThreadPoolExecutor.java:615)
在java.lang.Thread.run(Thread.java:745)
引起:org.apache.spark.SparkException:无法获取 broadcast_4的broadcast_4_piece0