Question

我确定没有人开始平衡，可能出现什么问题？

平衡运行： # hdfs balancer -threshold 1 16/02/19 15:10:02 INFO balancer.Balancer: Using a threshold of 1.0 16/02/19 15:10:02 INFO balancer.Balancer: namenodes = [hdfs://m1.h.c.test:8020, hdfs://m1.h.c.test] 16/02/19 15:10:02 INFO balancer.Balancer: parameters = Balancer.Parameters [BalancingPolicy.Node, threshold = 1.0, max idle iteration = 5, #excluded nodes = 0, #included nodes = 0, #source nodes = 0, run during upgrade = false] 16/02/19 15:10:02 INFO balancer.Balancer: included nodes = [] 16/02/19 15:10:02 INFO balancer.Balancer: excluded nodes = [] 16/02/19 15:10:02 INFO balancer.Balancer: source nodes = [] Time Stamp Iteration# Bytes Already Moved Bytes Left To Move Bytes Being Moved java.io.IOException: Another Balancer is running.. Exiting ...

我使用hdp包： ii hadoop-2-3-2-0-2950 2.7.1.2.3.2.0-2950 ii hadoop-2-3-2-0-2950-client 2.7.1.2.3.2.0-2950 ii hadoop-2-3-2-0-2950-hdfs 2.7.1.2.3.2.0-2950 ii hadoop-2-3-2-0-2950-hdfs-namenode 2.7.1.2.3.2.0-2950

Answer 1

您可以尝试： hdfs dfs -rm -skipTrash /system/balancer.id

Answer 2

它也可能是问题所描述的 https://issues.apache.org/jira/browse/HDFS-8897 - 这是HDFS HA配置特有的。

在HDFS 2.8和3.0中修复了问题。

Answer 3

只需运行以下命令即可终止该进程。

kill $(ps aux | grep 'balancer' | awk '{print $2}')

然后使用Ambari运行balancer。

如果您使用的是HA环境，请先使用找出运行进程的位置，

hdfs dfs -cat /system/balancer.id

Hdfs平衡器无法正常工作

3 个答案: