Question

我有一个本地火花群设置，有一台主机和一台从机。我在更多的机器上安装了Zeppelin并尝试从Zeppelin运行一些命令来激活主机。为此，我创建了一个主人为spark://<ip>:7077

的spark解释器

当我运行sc命令

时

它给出了这个错误

java.net.ConnectException：拒绝连接 java.net.PlainSocketImpl.socketConnect（Native Method）at java.net.AbstractPlainSocketImpl.doConnect（AbstractPlainSocketImpl.java:339）在 java.net.AbstractPlainSocketImpl.connectToAddress（AbstractPlainSocketImpl.java:200）在 java.net.AbstractPlainSocketImpl.connect（AbstractPlainSocketImpl.java:182）在java.net.SocksSocketImpl.connect（SocksSocketImpl.java:392）at java.net.Socket.connect（Socket.java:579）at org.apache.thrift.transport.TSocket.open（TSocket.java:182）at at org.apache.zeppelin.interpreter.remote.ClientFactory.create（ClientFactory.java:51）在 org.apache.zeppelin.interpreter.remote.ClientFactory.create（ClientFactory.java:37）在 org.apache.commons.pool2.BasePooledObjectFactory.makeObject（BasePooledObjectFactory.java:60）在 org.apache.commons.pool2.impl.GenericObjectPool.create（GenericObjectPool.java:861）在 org.apache.commons.pool2.impl.GenericObjectPool.borrowObject（GenericObjectPool.java:435）在 org.apache.commons.pool2.impl.GenericObjectPool.borrowObject（GenericObjectPool.java:363）在 org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.getClient（RemoteInterpreterProcess.java:139）在 org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret（RemoteInterpreter.java:192）在 org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret（LazyOpenInterpreter.java:93）在org.apache.zeppelin.notebook.Paragraph.jobRun（Paragraph.java:207）在org.apache.zeppelin.scheduler.Job.run（Job.java:170）at org.apache.zeppelin.scheduler.RemoteScheduler $ JobRunner.run（RemoteScheduler.java:304）在 java.util.concurrent.Executors $ RunnableAdapter.call（Executors.java:471）在java.util.concurrent.FutureTask.run（FutureTask.java:262）at java.util.concurrent.ScheduledThreadPoolExecutor中的$ ScheduledFutureTask.access $ 201（ScheduledThreadPoolExecutor.java:178）在 java.util.concurrent.ScheduledThreadPoolExecutor中的$ ScheduledFutureTask.run（ScheduledThreadPoolExecutor.java:292）在 java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）在 java.util.concurrent.ThreadPoolExecutor中的$ Worker.run（ThreadPoolExecutor.java:615）在java.lang.Thread.run（Thread.java:745）

我可以从zeppelin机器telnet端口7077。这也是我的本地虚拟机，所以不应该是防火墙问题，也禁用所有防火墙。

请让我知道这个问题。

Answer 1

也许你可以彻底解决这里报告的错误https://issues.apache.org/jira/browse/ZEPPELIN-305。

摘自该错误

I faced the same issue when I try to use Spark 1.5.1 under the latest version (0.6.0) of Zeppelin.

Following Dongjoon Hyun's suggestion, I set ZEPPELIN_MEM as -Xmx4g (the same value as SPARK_DRIVER_MEMORY in spark/conf/spark-env.sh) in zeppelin/conf/zeppelin-env.sh

export ZEPPELIN_MEM=-Xmx4g

As a result, the java.net.ConnectException problem is solved. Thanks!

Apache Zeppelin在不同的机器上给出错误火花

1 个答案: