构建集群时,Hadoop添加新的datanode失败

时间:2017-11-27 09:26:32

标签: hadoop

我使用official document逐步构建一个hadoop集群,大约有两个节点。

但追加datanode不会在Web UI上加入群集:http://{host address}:50070/dfshealth.html#tab-datanode

使用命令:

[az-user@AZ-TEST1-SPARK-SLAVE ~]$ yarn node --list
17/11/27 09:16:04 INFO client.RMProxy: Connecting to ResourceManager at /10.0.4.12:8032
Total Nodes:2
         Node-Id             Node-State Node-Http-Address       Number-of-Running-Containers
AZ-TEST1-SPARK-MASTER:37164             RUNNING AZ-TEST1-SPARK-MASTER:8042                                 0
AZ-TEST1-SPARK-SLAVE:42608              RUNNING AZ-TEST1-SPARK-SLAVE:8042                                  0

它显示有两个节点,但是另一个命令只显示一个livenode:

[az-user@AZ-TEST1-SPARK-SLAVE ~]$ hdfs dfsadmin -report 


Configured Capacity: 1081063493632 (1006.82 GB)
Present Capacity: 1026027008000 (955.56 GB)
DFS Remaining: 1026026967040 (955.56 GB)
DFS Used: 40960 (40 KB)
DFS Used%: 0.00%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0
Pending deletion blocks: 0

-------------------------------------------------
Live datanodes (1):

Name: 10.0.4.12:50010 (10.0.4.12)
Hostname: AZ-TEST1-SPARK-MASTER
Decommission Status : Normal
Configured Capacity: 1081063493632 (1006.82 GB)
DFS Used: 40960 (40 KB)
Non DFS Used: 97816576 (93.29 MB)
DFS Remaining: 1026026967040 (955.56 GB)
DFS Used%: 0.00%
DFS Remaining%: 94.91%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Mon Nov 27 09:22:36 UTC 2017

命令在主节点上显示相同的结果。

感谢您的任何建议。

其他消息

  1. 问题与number-of-nodes-in-hadoop-cluster类似,但在我的舞台上不起作用。

  2. 我像往常一样使用裸ip not config host ip文件。

  3. 固定

    在每个节点及其配置文件中使用主机名 在群集模式下,它必须使用主机名而不是裸ip。

0 个答案:

没有答案