Question

我正在尝试使用3台namenode计算机，2台datanodes计算机和1台客户端计算机运行hdfs。

执行hdfs zkfc –formatZK时我有下一个致命的错误，我不知道为什么，因为我已经尝试了其他时间的集群并且它有效，但现在它不起作用。

16/01/21 15:05:14 INFO zookeeper.ZooKeeper: Session: 0x25264b6c3d90000 closed
16/01/21 15:05:14 WARN ha.ActiveStandbyElector: Ignoring stale result from old client with sessionId 0x25264b6c3d90000
16/01/21 15:05:14 INFO zookeeper.ClientCnxn: EventThread shut down
16/01/21 15:05:14 FATAL tools.DFSZKFailoverController: Got a fatal error, exiting now
org.apache.hadoop.HadoopIllegalArgumentException: Bad argument: –formatZK
    at org.apache.hadoop.ha.ZKFailoverController.badArg(ZKFailoverController.java:251)
    at org.apache.hadoop.ha.ZKFailoverController.doRun(ZKFailoverController.java:214)
    at org.apache.hadoop.ha.ZKFailoverController.access$000(ZKFailoverController.java:61)
    at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:172)
    at org.apache.hadoop.ha.ZKFailoverController$1.run(ZKFailoverController.java:168)
    at org.apache.hadoop.security.SecurityUtil.doAsLoginUserOrFatal(SecurityUtil.java:415)
    at org.apache.hadoop.ha.ZKFailoverController.run(ZKFailoverController.java:168)
    at org.apache.hadoop.hdfs.tools.DFSZKFailoverController.main(DFSZKFailoverController.java:181)

我可以在没有任何错误的情况下运行下一个命令：

namenode1$ `hadoop-daemon.sh start journalnode`
namenode2$ `hadoop-daemon.sh start journalnode`
namenode3$ `hadoop-daemon.sh start journalnode`

namenode1$ `hadoop namenode -format`
namenode1$ `hadoop-daemon.sh start namenode`

namenode2$ `hadoop namenode -bootstrapStandby`
namenode2$ `hadoop-daemon.sh start namenode`

namenode1$ `hadoop-daemon.sh start zkfc`
namenode2$ `hadoop-daemon.sh start zkfc`
namenode3$ `hadoop-daemon.sh start zkfc`

但是当我使用namenode1：50070进入网页时，它看起来像待机状态，而namenode2：50070就是。我尝试将hdfs haadmin -getServiceState nn01与nn01和nn02一起使用，但两者都显示为待机状态。

我的配置是下一个：

等/主机

127.0.0.1 localhost
172.16.8.191 name1
172.16.8.192 name2
172.16.8.193 name3
172.16.8.202 data1
172.16.8.203 data2
172.16.8.204 client1

zoo.cfg

tickTime=2000

        dataDir=/opt/ZooData

        clientPort=2181

        initLimit=5
        syncLimit=2
        server.1=172.16.8.191:2888:3888
        server.2=172.16.8.192:2888:3888
        server.3=172.16.8.193:2888:3888

芯-site.xml中

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<configuration>
 <property>
    <name>fs.default.name</name>
    <value>hdfs://auto-ha</value>
 </property>
</configuration>

HDFS-site.xml中

<configuration>
     <property>
        <name>dfs.replication</name>
        <value>2</value>
    </property>
     <property>
        <name>dfs.name.dir</name>
        <value>file:///hdfs/name</value>
    </property>
     <property>
        <name>dfs.data.dir</name>
        <value>file:///hdfs/data</value>
    </property>
    <property>
        <name>dfs.permissions</name>
        <value>false</value>
    </property>
     <property>
        <name>dfs.nameservices</name>
        <value>auto-ha</value>
     </property>
     <property>
        <name>dfs.ha.namenodes.auto-ha</name>
        <value>nn01,nn02</value>
     </property>
     <property>
        <name>dfs.namenode.rpc-address.auto-ha.nn01</name>
        <value>name1:8020</value>
    </property>
    <property>
        <name>dfs.namenode.http-address.auto-ha.nn01</name>
        <value>name1:50070</value>
     </property>
    <property>
        <name>dfs.namenode.rpc-address.auto-ha.nn02</name>
        <value>name2:8020</value>
    </property>
    <property>
        <name>dfs.namenode.http-address.auto-ha.nn02</name>
        <value>name2:50070</value>
     </property>
     <property>
        <name>dfs.namenode.shared.edits.dir</name>
        <value>qjournal://name1:8485;name2:8485;name3:8485/auto-ha</value>
     </property>
    <property>
        <name>dfs.journalnode.edits.dir</name>
        <value>/hdfs/journalnode</value>
    </property>
    <property>
        <name>dfs.ha.fencing.methods</name>
        <value>sshfence</value>
    </property>
    <property>
        <name>dfs.ha.fencing.ssh.private-key-files</name>
        <value>/home/vagrant/.ssh/id_rsa</value>
    </property>
    <property>
        <name>dfs.ha.automatic-failover.enabled.auto-ha</name>
        <value>true</value>
    </property>
    <property>
        <name>ha.zookeeper.quorum</name>
        <value>name1:2181,name2:2181,name3:2181</value>
    </property>
</configuration>

Answer 1

当我从microsoft-word复制命令“hdfs zkfc -formatZK”时，该行长于你必须放入终端的命令的实线。

Word command: hdfs zkfc –formatZK

Real command: hdfs zkfc -formatZK

Answer 2

在zoo.cfg上你的zookeeper clientPort = 2181

在hdfs-site上，您将端口设为3000（尝试更改为2181）

即

  <property>
       <name>ha.zookeeper.quorum</name>
        <value>172.16.8.191:3000,172.16.8.192:3000</value>
  </property>

执行hdfs zkfc命令时出错

2 个答案: