Yarn-Cluster模式 - ApplicationMaster:SparkContext在等待100000 ms后没有初始化

时间:2017-02-06 21:07:16

标签: apache-spark pyspark yarn spark-submit

在我的pyspark计划中,我有,

./spark-submit --master yarn-cluster PySparkProgramPath  

运行我的pyspark程序
Exception in thread "main" org.apache.spark.SparkException: Application application_1482268372614_0318 finished with failed status

然后这个工作失败了

yarn logs -applicationId application_1482268372614_0318

运行ERROR ApplicationMaster: User class threw exception: java.io.IOException: Cannot run program ERROR ApplicationMaster: SparkContext did not initialize after waiting for 100000 ms. Please check earlier log output for errors. 后 它显示错误

yarn-client

[编辑]我在https://github.com/apache模式下提交此错误时未遇到此错误

0 个答案:

没有答案