消费者提交抵消但未通过/ v2 / kafka /(群集)/消费者列出

时间:2016-07-01 07:36:24

标签: apache-kafka

我设置了一个洞穴安装并指向我的Kafka服务器。(1个经纪人和1个动物园管理员)。当我打电话给/ v2 / kafka / kafka1 /消费者时,我得到了回复,没有 消费者。

{"error": false,"message": "consumer list returned","consumers": [],"request": {"url": "/v2/kafka/local/consumer/","host": "", "cluster": "local","group": "","topic": ""}}

我的burrow.cfg显示为

        [general]
        logdir=burrowlogs
        logconfig=config/logging.cfg
        pidfile=burrow.pid
        client-id=burrow-lagchecker
        group-blacklist=^(console-consumer-|python-kafka-consumer-).*$

        [zookeeper]
        hostname=
        port=2181
        timeout=6
        lock-path=/burrow/notifier

        [kafka "local"]
        broker=
        broker-port=9092
        zookeeper=
        zookeeper-port=2181
        zookeeper-path=/
        offsets-topic=__consumer_offsets

        [storm "local"]
        #zookeeper=zkhost01.example.com
        #zookeeper=zkhost02.example.com
        #zookeeper=zkhost03.example.com
        #zookeeper-port=2181
        #zookeeper-path=/kafka-cluster/stormconsumers

        [tickers]
        broker-offsets=60

        [lagcheck]
        intervals=10
        expire-group=604800

        [httpserver]
        server=on
        port=8080

        [smtp]
        server=mailserver.example.com
        port=25
        from=burrow-noreply@example.com
        template=config/default-email.tmpl

        [email "bofh@example.com"]
        group=local,critical-consumer-group
        group=local,other-consumer-group
        interval=60

        [httpnotifier]
        url=http://notification.server.example.com:9000/v1/alert
        interval=60
        extra=app=burrow
        extra=tier=STG
        template-post=config/default-http-post.tmpl
        template-delete=config/default-http-delete.tmpl
        timeout=5
        keepalive=30

        My burrow.out is

        Started Burrow at June 30, 2016 at 3:07pm (UTC)
        2016/06/30 15:10:27 http: multiple response.WriteHeader calls
        2016/06/30 15:10:29 http: multiple response.WriteHeader calls
        2016/06/30 15:10:38 http: multiple response.WriteHeader calls
        2016/06/30 15:10:39 http: multiple response.WriteHeader calls
        2016/06/30 15:10:40 http: multiple response.WriteHeader calls
        2016/06/30 15:10:41 http: multiple response.WriteHeader calls
        2016/06/30 15:10:42 http: multiple response.WriteHeader calls
        2016/06/30 15:10:44 http: multiple response.WriteHeader calls
        2016/06/30 15:10:45 http: multiple response.WriteHeader calls
        2016/06/30 15:10:45 http: multiple response.WriteHeader calls
        2016/06/30 15:10:47 http: multiple response.WriteHeader calls

我使用的是Kafka版本0.10.0。

我的offset.storage = kafka。

我知道群集已连接到使用者并处理消息。所有其他端点,而不是消费者级别,似乎工作正常。

1 个答案:

答案 0 :(得分:1)

此问题已解决。只需要在我的burrow.cfg中添加zookeeper-offset = true,如果你在zookeeper中存储Kafka主题的偏移细节,这将解决问题。