我正在尝试在笔记本电脑上安装Hadoop。我遵循了此指南:https://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
当我尝试运行start-all.sh时,我得到了:
vava@vava-ThinkPad:/usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting datanodes
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
Starting secondary namenodes [vava-ThinkPad]
pdsh@vava-ThinkPad: vava-ThinkPad: rcmd: socket: Permission denied
Starting resourcemanager
resourcemanager is running as process 3748. Stop it first.
Starting nodemanagers
pdsh@vava-ThinkPad: localhost: rcmd: socket: Permission denied
我尝试遵循以下问题,但没有任何改变:
starting hadoop process using start-all.sh runs into issues
编辑:
在尝试了所有选项之后,似乎唯一可行的选项是export PDSH_RCMD_TYPE=ssh
。
现在问题出在namenode和datanode上。它无法正常启动:
vava@vava-ThinkPad:/usr/local/hadoop-3.1.1$ sbin/start-all.sh
WARNING: Attempting to start all Apache Hadoop daemons as vava in 10 seconds.
WARNING: This is not a recommended production deployment configuration.
WARNING: Use CTRL-C to abort.
Starting namenodes on [localhost]
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting datanodes
localhost: ERROR: Cannot set priority of datanode process 10937
pdsh@vava-ThinkPad: localhost: ssh exited with exit code 1
Starting secondary namenodes [vava-ThinkPad]
Starting resourcemanager
Starting nodemanagers
答案 0 :(得分:0)
export PDSH_RCMD_TYPE=ssh
在您的终端机中sudo /usr/local/hadoop-3.1.1/sbin$ bash start-all.sh
chmod -R 755 /usr/local/hadoop-3.1.1
JAVA_HOME
中设置hadoop-env.sh
,并确保此文件中的所有其他选项正确Attempting to start all Apache Hadoop daemons as
vava in 10 seconds.
“ vava
” 是错误的,请尝试su -l hdfs
然后运行脚本答案 1 :(得分:0)
创建一个新文件
/etc/pdsh/rcmd_default
在其中写入“ ssh”,然后保存并退出。确保输入回车符并开始新行,否则将提示使用代码1的SSH退出
echo "ssh" > /etc/pdsh/rcmd_default
答案 2 :(得分:0)
就我而言,您需要确保将RSA复制到当前的本地主机
ssh-copy-id -i /home/hadoop/.ssh/id_rsa.pub hadoop@localhost
假定您使用“ hadoop”登录到节点主服务器