Zookeeper错误连接丢失异常

时间:2013-07-08 18:37:33

标签: apache hadoop mapreduce hbase apache-zookeeper

我在亚马逊EC2实例上运行SeqWare VM我正在尝试使用SeqWare查询引擎从VCF文件中查询数据。当我第一次启动实例并按照说明导入数据时,它工作正常,并继续工作,直到我停止实例。当我重新启动它。它不会让我导入任何东西,也不会创建新的工作区。它总是返回以下错误。我查看了进程,发现所有必需的节点都没有运行,所以我登录到root并转到etc/init.d目录并再次启动所有内容,此时,当T尝试导入数据时,我不知道甚至得到一个错误,我必须停止这个过程。

[seqware@master target]$ java -classpath seqware-distribution-0.13.6.7-qe-full.jar com.github.seqware.queryengine.system.importers.SOFeatureImporter -i ../../seqware-queryengine/src/test/resources/com/github/seqware/queryengine/system/FeatureImporter/consequences_annotated.vcf ALL.chr3.phase1_release_v3.20101123.snps_indels_svs.genotypes.3_100001-101000.vcf -o keyValueVCF.out -r hg_19 -s c111aea5-5e18-4c62-a8a7-ec82fe151301 -a ad_hoc -w VCFVariantImportWorker                 
[SeqWare Query Engine] 0    [main] ERROR org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper  - ZooKeeper exists failed after 3 retries
[SeqWare Query Engine] 1    [main] ERROR org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher  - hconnection Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
        at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:569)
        at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:186)
        at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:100)
        at com.github.seqware.queryengine.impl.HBaseStorage.<init>(HBaseStorage.java:89)
        at com.github.seqware.queryengine.factory.SWQEFactory$Storage_Type$3.buildStorage(SWQEFactory.java:109)
        at com.github.seqware.queryengine.factory.SWQEFactory.getStorage(SWQEFactory.java:174)
        at com.github.seqware.queryengine.factory.SWQEFactory.getQueryInterface(SWQEFactory.java:199)
        at com.github.seqware.queryengine.impl.SimpleModelManager.<init>(SimpleModelManager.java:49)
        at com.github.seqware.queryengine.impl.HBaseModelManager.<init>(HBaseModelManager.java:36)
        at com.github.seqware.queryengine.impl.MRHBaseModelManager.<init>(MRHBaseModelManager.java:32)
        at com.github.seqware.queryengine.factory.SWQEFactory.getModelManager(SWQEFactory.java:211)
        at com.github.seqware.queryengine.system.importers.FeatureImporter.performImport(FeatureImporter.java:66)
        at com.github.seqware.queryengine.system.importers.SOFeatureImporter.runMain(SOFeatureImporter.java:141)
        at com.github.seqware.queryengine.system.importers.SOFeatureImporter.main(SOFeatureImporter.java:60)
[SeqWare Query Engine] 3    [main] FATAL org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation  - Unexpected exception during initialization, aborting
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:154)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:226)
        at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:580)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:569)
        at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:186)
        at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:100)
        at com.github.seqware.queryengine.impl.HBaseStorage.<init>(HBaseStorage.java:89)
        at com.github.seqware.queryengine.factory.SWQEFactory$Storage_Type$3.buildStorage(SWQEFactory.java:109)
        at com.github.seqware.queryengine.factory.SWQEFactory.getStorage(SWQEFactory.java:174)
        at com.github.seqware.queryengine.factory.SWQEFactory.getQueryInterface(SWQEFactory.java:199)
        at com.github.seqware.queryengine.impl.SimpleModelManager.<init>(SimpleModelManager.java:49)
        at com.github.seqware.queryengine.impl.HBaseModelManager.<init>(HBaseModelManager.java:36)
        at com.github.seqware.queryengine.impl.MRHBaseModelManager.<init>(MRHBaseModelManager.java:32)
        at com.github.seqware.queryengine.factory.SWQEFactory.getModelManager(SWQEFactory.java:211)
        at com.github.seqware.queryengine.system.importers.FeatureImporter.performImport(FeatureImporter.java:66)
        at com.github.seqware.queryengine.system.importers.SOFeatureImporter.runMain(SOFeatureImporter.java:141)
        at com.github.seqware.queryengine.system.importers.SOFeatureImporter.main(SOFeatureImporter.java:60)

2 个答案:

答案 0 :(得分:1)

我弄清楚了。从cloudera包中安装了apache服务。当实例重新启动时,它们没有被重新启动,显然,只是从etc / init.d运行它们的脚本是不正确的方法。我在cloudera文档中找到了重启它们的命令。

答案 1 :(得分:0)

我也遇到了这个问题。我可以通过在启动zookeeper时提供jute.maxbuffer参数来解决这个问题。

有关详细信息,请参阅 https://issues.apache.org/jira/browse/SOLR-4793