Spark:与远程系统的关联失败。原因:解散了

时间:2016-10-09 02:16:36

标签: apache-spark cassandra akka datastax datastax-startup

我有一个独立的火花工作,每次工作完成时,都会出现以下警告:我不太了解这个的含义以及如何解决这个问题。如果你能提供帮助会很棒。感谢

 WARN  [SparkWorker-0 error logger] 2016-10-08 10:18:33,395 SparkWorker-0 ExternalLogger.java:92 
- Association with remote system [akka.tcp://sparkExecutor@10.47.183.30:39422] has failed, address is now gated for [5000] ms. Reason is: [Disassociated].
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,406  Logging.scala:59 - Removing executor app-20161008101807-0002/5 because it is EXITED
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,407  Logging.scala:59 - Launching executor app-20161008101807-0002/6 on worker worker-20161008093556-10.47.183.121-41649
    WARN  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,762  Logging.scala:71 - Got status update for unknown executor app-20161008100608-0001/4
    INFO  [sparkMaster-akka.actor.default-dispatcher-4] 2016-10-08 10:18:33,819  Logging.scala:59 - akka.tcp://sparkDriver@XXX.196.201.23:36340 got disassociated, removing it.
    INFO  [SparkWorker-0 logger] 2016-10-08 10:18:33,835 SparkWorker-0 ExternalLogger.java:88 - Executor app-20161008100608-0001/0 finished with state KILLED exitStatus 143
    WARN  [sparkMaster-akka.actor.default-dispatcher-5] 2016-10-08 10:18:33,837  Logging.scala:71 - Got status update for unknown executor app-20161008100608-0001/0

1 个答案:

答案 0 :(得分:0)

这只是遗嘱执行人说它无法与任何人交谈。我会检查防火墙上的连接端口等。