在自定义环境中安装Apache Kylin

时间:2019-09-27 02:31:07

标签: kylin

我正在尝试在Ubuntu 16.04中安装Apache Kylin。

我已安装:

  • 在伪分布式模式下运行hadoop 3.1.2(fs.default.name:hdfs:// localhost:9000)
  • apache配置单元3.1.2和db derby 10.14.2.0(配置配置单元使用db derby)
  • 在伪分布式模式下的hbase 1.4.10(使用hdfs:// localhost:9000 / hbase)

但是当我打电话时:

  • hbase外壳
  • hbase(main):001:0>列表

获取错误:

ERROR: Can't get master address from ZooKeeper; znode data == null

Here is some help for this command:
List all user tables in hbase. Optional regular expression parameter could
be used to filter the output. Examples:

  hbase> list
  hbase> list 'abc.*'
  hbase> list 'ns:abc.*'
  hbase> list 'ns:.*'

当我打电话时:

  • ssh localhost
  • kylin.sh开始

获取错误

2019-09-27 09:26:41,029 INFO  [main] client.ZooKeeperRegistry:107 : ClusterId read in ZooKeeper is null
Exception in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase
    at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:99)
    at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:111)
    at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:99)
    at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:43)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
    at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:92)
    ... 3 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Can't get the location for replica 0
    at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.getRegionLocations(RpcRetryingCallerWithReadReplicas.java:372)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:153)
    at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:58)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:219)
    at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:275)
    at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:436)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:310)
    at org.apache.hadoop.hbase.MetaTableAccessor.fullScan(MetaTableAccessor.java:639)
    at org.apache.hadoop.hbase.MetaTableAccessor.tableExists(MetaTableAccessor.java:366)
    at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:409)
    at org.apache.kylin.storage.hbase.HBaseConnection.tableExists(HBaseConnection.java:281)
    at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:306)
    at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:114)
    at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:88)
    ... 8 more

2 个答案:

答案 0 :(得分:1)

从错误中可以明显看出您的HBase没有运行;请确保HBase良好。

答案 1 :(得分:0)

Hadoop历史悠久且复杂,因此我们建议您使用经过良好测试的Hadoop发行版,例如CDH和HDP,但不要使用自定义Hadoop环境。    如果您要进行PoC并想快速学习Kylin,请使用Docker映像https://hub.docker.com/r/apachekylin/apache-kylin-standalone。如果要在更正式的Hadoop环境中使用Kylin,可以使用CDH 5.x或HDP 2.x Hadoop发行版吗?    如果您还有其他问题,请通过用户邮件列表与Kylin社区联系。