java.io.IOException:等待迷你HDFS集群启动时超时

时间:2019-05-24 09:12:43

标签: hadoop hbase

尝试启动Hbase mini集群时出现超时异常。此外,我想编写一个hbase测试用例,但当前它无法用于hadoop 3.1.1和hbase 2.0.2组合。

1)尝试使用> = 3.1.1和hbase> = 2.0.0的所有版本 2)从https://github.com/apache/hbase/blob/rel/2.0.2/hbase-server/src/test/java/org/apache/hadoop/hbase/TestHBaseTestingUtility.java处获取了代码 和 https://github.com/apache/ranger/blob/master/hbase-agent/src/test/java/org/apache/ranger/authorization/hbase/HBaseRangerAuthorizationTest.java

import java.net.ServerSocket;
import org.apache.hadoop.hbase.HBaseTestingUtility;
import org.apache.hadoop.hbase.HConstants;
public class HBaseRangerAuthorizationTest2 {

        private static int port;
        private static HBaseTestingUtility utility;
        public static void main(String args[]) {
            try {
                port = getFreePort();     
                utility = new HBaseTestingUtility();
                utility.getConfiguration().set("test.hbase.zookeeper.property.clientPort", "" + port);
                utility.getConfiguration().set("hbase.master.port", "" + getFreePort());
                utility.getConfiguration().set("hbase.master.info.port", "" + getFreePort());
                utility.getConfiguration().set("hbase.regionserver.port", "" + getFreePort());
                utility.getConfiguration().set("hbase.regionserver.info.port", "" + getFreePort());
                utility.getConfiguration().set("zookeeper.znode.parent", "/hbase-unsecure");
                utility.startMiniCluster();

                /*
                utility= new HBaseTestingUtility();
                // Set a different zk path for each cluster
                utility.getConfiguration().set(HConstants.ZOOKEEPER_ZNODE_PARENT, "/1");
                utility.startMiniZKCluster();
                utility.startMiniCluster();*/
            }catch(Exception e) {
                e.printStackTrace();
            }
        }
        public static int getFreePort() throws IOException {
            ServerSocket serverSocket = new ServerSocket(0);
            int port = serverSocket.getLocalPort();
            serverSocket.close();
            return port;
        }
}```

I expect the mini server should start without fail.

1 个答案:

答案 0 :(得分:0)

我正在使用hadoop 2.7.3版和hbase 1.1.2版

对于超时异常,请将hadoop-client依赖项添加到gradle文件中:

compile 'org.apache.hadoop:hadoop-client:2.7.3'

进一步检查是否已添加依赖项:

compile 'org.apache.hbase:hbase-testing-util:1.1.2'