为了让EclairJS客户端与Apache Spark交谈,它需要运行Apache Toree的实例,而Toree必须能够连接到您的Spark主机。
先决条件
Java 8更新70或更高版本
说明
下载使用Hadoop 2.7构建的Apache Spark 2.0.0并从存档中提取它。
安装Jupyter(例如pip install jupyter
)和Jupyter内核网关(pip install jupyter-kernel-gateway
)
下载并构建Apache Toree
$ git clone https://github.com/apache/incubator-toree
$ cd incubator-toree
$ git checkout e8ecd0623c65ad104045b1797fb27f69b8dfc23f
$ make dist
在构建Apache Toree时,我在上面的步骤中收到错误:
APACHE_SPARK_VERSION=2.0.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt toree/assembly
/bin/sh: 1: sbt: not found
Makefile:133: recipe for target 'target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar' failed
make: *** [target/scala-2.11/toree-assembly-0.2.0.dev1-incubating-SNAPSHOT.jar] Error 127
我无法弄清楚接下来该做什么,任何人都可以帮助我!