Question

我正在尝试在笔记本电脑上安装Hadoop。我遵循了此指南：https://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

当我尝试运行start-all.sh时，我得到了：

vava@vava-ThinkPad:/usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.

WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting datanodes
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting secondary namenodes [vava-ThinkPad]
pdsh@vava-ThinkPad: vava-ThinkPad: rcmd: socket: Permission denied
Starting resourcemanager
resourcemanager is running as process 3748.  Stop it first.
Starting nodemanagers
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied

我尝试遵循以下问题，但没有任何改变：

starting hadoop process using start-all.sh runs into issues

Hadoop permission issue

编辑： 在尝试了所有选项之后，似乎唯一可行的选项是export PDSH_RCMD_TYPE=ssh。现在问题出在namenode和datanode上。它无法正常启动：

vava@vava-ThinkPad:/usr/local/hadoop-3.1.1$ sbin/start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting datanodes
localhost: ERROR: Cannot set priority of datanode process 10937
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting secondary namenodes [vava-ThinkPad]
Starting resourcemanager
Starting nodemanagers

Answer 1

我会检查：

export PDSH_RCMD_TYPE=ssh在您的终端机中
本地防火墙设置
以root用户身份运行命令：sudo /usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
chmod -R 755 /usr/local/hadoop-3.1.1

对于您的其他问题：

在JAVA_HOME中设置hadoop-env.sh，并确保此文件中的所有其他选项正确
更改用户，Attempting to start all Apache Hadoop daemons as vava in 10 seconds. “ vava” 是错误的，请尝试su -l hdfs然后运行脚本

Answer 2

创建一个新文件

/etc/pdsh/rcmd_default

在其中写入“ ssh”，然后保存并退出。确保输入回车符并开始新行，否则将提示使用代码1的SSH退出

echo "ssh" > /etc/pdsh/rcmd_default

Answer 3

就我而言，您需要确保将RSA复制到当前的本地主机

ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub hadoop@localhost

假定您使用“ hadoop”登录到节点主服务器

HADOOP-权限被拒绝执行start-all.sh

3 个答案:

我会检查：

对于您的其他问题：