从eclipse启动远程spark作业时出错

时间:2017-04-05 05:33:14

标签: eclipse hadoop apache-spark cloudera-cdh

当我尝试从eclipse启动远程火花作业到CDH群集时,作业被杀死,当我看到容器的日志时我看到下面的错误

Log Type: stderr

Log Upload Time: Wed Apr 05 10:56:13 +0530 2017

Log Length: 87

Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher


Log Type: stdout

Log Upload Time: Wed Apr 05 10:56:13 +0530 2017

Log Length: 0 

请帮我解决这个问题。

提前致谢

1 个答案:

答案 0 :(得分:0)

我通过在spark上下文创建代码中添加yarn的类路径来解决这个问题