创建spark会话时出错

时间:2017-05-05 10:11:13

标签: apache-spark spark-dataframe datastax

我正在尝试使用spark会话连接到DSE 5.1群集。我在使用群集url时遇到以下错误。但是如果我将master设置为localhost则一切正常。

SparkSession.builder().appName(getClass.getSimpleName).master(""spark://10.10.10.10:1010"") >>> error.
SparkSession.builder().appName(getClass.getSimpleName).master("localhost") >>

工作正常。

错误的堆栈跟踪:

17/05/05 12:44:22 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/05/05 12:45:23 ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
17/05/05 12:45:23 WARN StandaloneSchedulerBackend: Application ID is not initialized yet.
17/05/05 12:45:23 WARN StandaloneAppClient$ClientEndpoint: Drop UnregisterApplication(null) because has not yet connected to master
17/05/05 12:45:23 ERROR MapOutputTrackerMaster: Error communicating with MapOutputTracker
java.lang.InterruptedException

0 个答案:

没有答案