使用importtsv将数据加载到HBASE会导致错误

时间:2014-08-11 07:46:13

标签: hadoop hbase apache-zookeeper

我正在尝试使用importtsv工具将CSV文件中的数据加载到HBASE中。我已经建立了一个由3台机器组成的集群。 这是我的hbase-site.xml文件

<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://ec2-54-190-103-64.us-west-2.compute.amazonaws.com:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
 <property>
   <name>hbase.zookeeper.quorum</name>
   <value>ec2-54-203-95-235.us-west-2.compute.amazonaws.com</value>
  </property>
 <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

  <property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
   </property>
   <property>
   <name>hbase.zookeeper.property.dataDir</name>
   <value>/home/ubuntu/zookeeper</value>
   <description>Property from ZooKeeper's config zoo.cfg.
   The directory where the snapshot is stored.
    </description>
 </property>
 </configuration>

当我开始运行jps时。在主节点下我看到HMaster,在数据节点下我看到Hquorumpeer和Hregionserver 当我尝试加载数据时,我得到以下错误

INFO zookeeper.ClientCnxn: Opening socket connection to server       localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
 14/08/11 07:41:28 WARN zookeeper.ClientCnxn: Session 0x0 for server null,    unexpected     error, closing socket connection and attempting reconnect
  java.net.ConnectException: Connection refused
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
    at   org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   14/08/11 07:41:28 WARN zookeeper.RecoverableZooKeeper: Possibly transient   ZooKeeper    exception: org.apache.zookeeper.KeeperException$ConnectionLossException:    KeeperErrorCode = ConnectionLoss for /hbase
 14/08/11 07:41:28 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
  14/08/11 07:41:29 INFO zookeeper.ClientCnxn: Opening socket connection to server   localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)

不确定zookeeper的问题是什么。提前致谢

1 个答案:

答案 0 :(得分:0)

您需要在hbase-site.xml文件(主服务器和从服务器)中添加以下属性

<property>
 <name>hbase.zookeeper.property.maxClientCnxns</name>
 <value>1000</value>
</property>