安装Apache Spot

时间:2018-10-09 17:56:05

标签: linux ubuntu hadoop apache-spot

我需要在Ubuntu上安装Apache Spot。

http://spot.incubator.apache.org/doc/#installation

我已经按照该指南设置了Hadoop的单节点集群:

https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html

并且我已经按照Apache文档中编写的指南安装了Hive,Kafka和Spark。 主要问题是我无法正确配置文件“ /spot-setup/spot.conf”,因为当我运行命令时:

./hdfs_setup.sh

终端显示:

sudo: unknown user: hdfs
sudo: unable to initialize policy plugin
./hdfs_setup.sh:line 48:hdfs:command not found
./hdfs_setup.sh:line 52:hdfs:command not found
./hdfs_setup.sh: line 62:impala-shell:command not found

我的/ etc / hosts文件是:

127.0.0.1 localhost
127.0.1.1 osboxes
127.0.0.2 node03
127.0.0.3 node04
127.0.0.4 node16

我应该在spot.conf的行中写入哪些值? 非常感谢。

1 个答案:

答案 0 :(得分:0)

脚本输出表明hadoop没有在该节点中正确配置。您可以尝试What is a raw type and why shouldn't we use it?来打包Apache Spot所需的所有依赖项,而不必单独安装和配置依赖项。