HADOOP-权限被拒绝执行start-all.sh

时间:2018-09-10 13:20:08

标签: ubuntu hadoop hdfs

我正在尝试在笔记本电脑上安装Hadoop。我遵循了此指南:https://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

当我尝试运行start-all.sh时,我得到了:

vava@vava-ThinkPad:/usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.

WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting datanodes
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting secondary namenodes [vava-ThinkPad]
pdsh@vava-ThinkPad: vava-ThinkPad: rcmd: socket: Permission denied
Starting resourcemanager
resourcemanager is running as process 3748.  Stop it first.
Starting nodemanagers
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied

我尝试遵循以下问题,但没有任何改变:

starting hadoop process using start-all.sh runs into issues

Hadoop permission issue

编辑: 在尝试了所有选项之后,似乎唯一可行的选项是export PDSH_RCMD_TYPE=ssh。 现在问题出在namenode和datanode上。它无法正常启动:

vava@vava-ThinkPad:/usr/local/hadoop-3.1.1$ sbin/start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting datanodes
localhost: ERROR: Cannot set priority of datanode process 10937
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting secondary namenodes [vava-ThinkPad]
Starting resourcemanager
Starting nodemanagers

3 个答案:

答案 0 :(得分:0)

我会检查:

  • export PDSH_RCMD_TYPE=ssh在您的终端机中
  • 本地防火墙设置
  • 以root用户身份运行命令:sudo /usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
  • chmod -R 755 /usr/local/hadoop-3.1.1

对于您的其他问题:

  • JAVA_HOME中设置hadoop-env.sh,并确保此文件中的所有其他选项正确
  • 更改用户,Attempting to start all Apache Hadoop daemons as vava in 10 seconds. vava是错误的,请尝试su -l hdfs然后运行脚本

答案 1 :(得分:0)

创建一个新文件

/etc/pdsh/rcmd_default

在其中写入“ ssh”,然后保存并退出。确保输入回车符并开始新行,否则将提示使用代码1的SSH退出

echo "ssh" > /etc/pdsh/rcmd_default

答案 2 :(得分:0)

就我而言,您需要确保将RSA复制到当前的本地主机

ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub hadoop@localhost

假定您使用“ hadoop”登录到节点主服务器