Question

我将DSE更新为5.1.2并启用了DSE统一身份验证。

当我运行“dse -u xxx -p xxx spark”时，我得到一个shell，但如果我使用“spark.sql”提交查询，我会收到错误：

scala> val result = spark.sql("SELECT id FROM xxx.yyy")
java.lang.RuntimeException: com.datastax.bdp.fs.client.InternalServerException: Server returned HTTP error response  500 (Internal Server Error)
Caused by: com.datastax.bdp.fs.client.InternalServerException: Server returned HTTP error response  500 (Internal Server Error)
  at com.datastax.bdp.fs.client.DseFsClient$stateMachine$macro$1$1.apply(DseFsClient.scala:132)

在/var/log/cassandra/system.log中，我看到了：

WARN  [Native-Transport-Requests-2] 2017-08-31 12:05:29,057  DseAuthenticator.java:659 - Plain text authentication without client / server encryption is strongly discouraged
ERROR [dsefs-netty-worker-4] 2017-08-31 12:05:29,842 DSEFS RestServerHandler.scala:287 - [id: 0x1810ea2d, L:/10.225.155.31:5598 - R:/10.225.155.31:58006] RestHandler invocation failed
java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried)
    at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299) ~[guava-18.0.jar:na]
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried)

知道如何解决这个问题。顺便说一下，dse spark-submit有效......

Answer 1

通过在dse.yaml中启用dsefs来解决问题。

启用DSE统一身份验证后，“dse spark”失败

1 个答案: