我正在尝试在群集模式下执行Tweets
示例。失败时出现以下错误:
C:\spark-2.1.0-bin-hadoop2.7\bin>spark-submit --master spark://10.156.11.126:7077 --deploy-mode cluster --class example.PrintTweets C:\Users\j1008523\workspace1\target\scala-2.11\spark-twitter-lang-classifier-assembly-2.0.0
Running Spark using the REST application submission protocol.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
17/06/14 10:36:48 INFO RestSubmissionClient: Submitting a request to launch an application in spark://10.156.11.126:7077.
17/06/14 10:37:00 WARN RestSubmissionClient: Unable to connect to server spark://10.156.11.126:7077.
Warning: Master endpoint spark://10.156.11.126:7077 was not a REST server. Falling back to legacy submission gateway instead.
17/06/14 10:37:03 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
当我删除--deploy-mode cluster
时,它可以工作并在控制台上显示推文
我使用sbt程序集构建了包,因此所有相关的jar都存在于
spark-twitter-lang-classifier-assembly-2.0.0
。我在Windows系统上运行
非常感谢任何帮助