在群集模式下提交作业时,spark提交失败

时间:2017-06-14 05:39:48

标签: apache-spark

我正在尝试在群集模式下执行Tweets示例。失败时出现以下错误:

C:\spark-2.1.0-bin-hadoop2.7\bin>spark-submit  --master spark://10.156.11.126:7077  --deploy-mode cluster --class example.PrintTweets C:\Users\j1008523\workspace1\target\scala-2.11\spark-twitter-lang-classifier-assembly-2.0.0

Running Spark using the REST application submission protocol.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
17/06/14 10:36:48 INFO RestSubmissionClient: Submitting a request to launch an application in spark://10.156.11.126:7077.
17/06/14 10:37:00 WARN RestSubmissionClient: Unable to connect to server spark://10.156.11.126:7077.
Warning: Master endpoint spark://10.156.11.126:7077 was not a REST server. Falling back to legacy submission gateway instead.
17/06/14 10:37:03 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

当我删除--deploy-mode cluster时,它可以工作并在控制台上显示推文

我使用sbt程序集构建了包,因此所有相关的jar都存在于 spark-twitter-lang-classifier-assembly-2.0.0。我在Windows系统上运行

非常感谢任何帮助

0 个答案:

没有答案