thrift + hbase异常(在docker容器中)

时间:2016-11-21 09:37:31

标签: docker hbase docker-compose thrift

我尝试将遗留系统从hbase和php模块拆分为两个独立的容器,并使用以下docker-compose文件:

version: '2'
services:
  php:
    image: my-legacy-php
    volumes:
      - ~/workspace/php:/workspace/php
    ports:
      - "80:80"
    links:
      - hbase:hbase-docker
  hbase:
    image: dajobe/hbase
    hostname: hbase-docker
    ports:
      - "43590-44000:43590-44000"
      - "8085:8085"
      - "2181:2181"
      - "8080:8080"
      - "16010:16010"
      - "9095:9095"
      - "9090:9091"
      - "16020:16020"
      - "16030:16030"
      - "60000:60000"
    volumes:
      - ~/workspace/hbase-docker/data:/data

我使用dajobe/hbase的hbase公共docker镜像。 现在我试图将一些事件(HTTP GET请求)发送到php moudle并在我的php模块(Thrift lib)中获得以下异常:

ERROR HBaseFacade - exception in handling rcomEvent: Internal error processing increment, trace is: #0 /workspace/php/libs/thrift-0.8.0/packages/Hbase/THBaseService.php(536): THBaseServiceClient->recv_increment()

在hbase容器中我看到以下异常(在/data/log/hbase-thrift.log中):

2016-11-21 09:13:29,620 ERROR [thrift-worker-0] thrift.ProcessFunction: Internal error processing increment
java.lang.NullPointerException
    at org.apache.hadoop.hbase.thrift.ThriftServerRunner$HBaseHandler.increment(ThriftServerRunner.java:1747)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.hbase.thrift.HbaseHandlerMetricsProxy.invoke(HbaseHandlerMetricsProxy.java:67)
    at com.sun.proxy.$Proxy9.increment(Unknown Source)
    at org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$increment.getResult(Hbase.java:4537)
    at org.apache.hadoop.hbase.thrift.generated.Hbase$Processor$increment.getResult(Hbase.java:4521)
    at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
    at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
    at org.apache.hadoop.hbase.thrift.TBoundedThreadPoolServer$ClientConnnection.run(TBoundedThreadPoolServer.java:289)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)

有什么想法吗?

编辑:我的本地hbase版本(使用我的php模块)为0.94.26,hbase-docker运行1.1.4

1 个答案:

答案 0 :(得分:0)

我的解决方案是在hbase容器中运行thrift2而不是thrift

来自https://github.com/dajobe/hbase-docker/blob/master/hbase-server

: 我改变了:

hbase thrift start > $logs_dir/hbase-thrift.log 2>&1 &

为:

hbase thrift2 start > $logs_dir/hbase-thrift.log 2>&1 &