Vora无法连接到Consul Agent

时间:2016-04-05 04:36:13

标签: apache-spark sap vora

我在基于SLES 11 SP3的HDP2.3上安装了Vora 1.2。

当我尝试对Vora进行基于命令行的验证时,根据新安装和管理员手册的第2.7节(第34页),我现在收到一个新错误:

scala> vc.sql(testsql)

com.sap.spark.vora.discovery.DiscoveryException: Could not connect to Consul Agent on localhost:8500 : null        at
 com.sap.spark.vora.discovery.ConsulDiscoveryClient$ConsulDiscoveryClient.(ConsulDiscoveryClient.scala:38)        at 
com.sap.spark.vora.discovery.ConsulDiscoveryClient$.getClient(ConsulDiscoveryClient.scala:21)        at 
com.sap.spark.vora.discovery.DiscoveryClientFactory$.getClient(DiscoveryClientFactory.scala:9)        at 
com.sap.spark.vora.config.VoraConfiguration$.apply(VoraConfiguration.scala:24)        at 
com.sap.spark.vora.DefaultSource.buildConfiguration(DefaultSource.scala:403)        at 
com.sap.spark.vora.DefaultSource.createRelation(DefaultSource.scala:149)        at org.apache.spark.sql.execution.datasources.CreateTableUsingTemporaryAwareCommand.resolveDataSource(CreateTableUsingTemporaryAwareCommand.scala:73)        at org.apache.spark.sql.execution.datasources.CreateTableUsingTemporaryAwareCommand.run(CreateTableUsingTemporaryAwareCommand.scala:31)        at org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult$lzycompute(commands.scala:57)        at org.apache.spark.sql.execution.ExecutedCommand.sideEffectResult(commands.scala:57)        at org.apache.spark.sql.execution.ExecutedCommand.doExecute(commands.scala:69)        at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:140)        at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$5.apply(SparkPlan.scala:138)        at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:147)        at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:138)        at org.apache.spark.sql.SQLContext$QueryExecution.toRdd$lzycompute(SQLContext.scala:933)        at org.apache.spark.sql.SQLContext$QueryExecution.toRdd(SQLContext.scala:933)        at org.apache.spark.sql.DataFrame.(DataFrame.scala:144)        at org.apache.spark.sql.DataFrame.(DataFrame.scala:129)        at org.apache.spark.sql.DataFrame$.apply(DataFrame.scala:51)        at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:725)

我在Zeppelin中遇到了同样的错误。我的服务器上缺少Consul的东西吗?

1 个答案:

答案 0 :(得分:0)

正如Vora Troubleshooting Wiki的评论部分所指出的那样:

Vora Discovery Service使用Consul(来自HashiCorp)注册服务。每个服务器都需要一个Consul服务器或Consul代理(互斥作为服务器和代理侦听端口8500;至少需要3个Consul服务器 - 非服务器主机应该有一个客户端)。您的错误消息表明主机没有运行Consul服务器或代理。

与Vora1.1相比,Vora1.2具有与许多新服务不同的架构。请参阅What's New in Vora 1.2Vora Installation and Administration Guide。 Vora Discovery Service(= Consul)是需要安装的新组件之一。

至少需要3台计算机才能拥有​​至少3台Vora Discovery Server。每个服务器也充当客户端,因此具有代理的其他主机是可选的(但如果存在其他主机,则需要运行发现代理)。