Apache flink-kafka在单个flink-kafka用户组中添加多个用户

时间:2019-01-18 13:45:25

标签: apache-kafka apache-flink flink-streaming

I am reading a "ABC" topic which have 5 partitions 

但是实际上,当我创建一个使用者组(即Flinkkafkaconsumer09)时,它只有一个使用者实例,并且该使用者正在使用所有分区。

I am trying to have a consumer group with 5 

其中的消费者实例导致,我需要1个消费者用于1个分区。

Any suggestions to help me out! 


This is what I am getting 

组主题分区电流偏移量对数偏移量滞后所有者     console-consumer-81434 CT9 0 1 1 0 消费者1 /127.0.0.1     console-consumer-81434 CT9 1 7 7 0 消费者1 /127.0.0.1     console-consumer-81434 CT9 2 1 1 0 消费者1 /127.0.0.1     console-consumer-81434 CT9 3 3 3 0 消费者1 /127.0.0.1     console-consumer-81434 CT9 4 5 5 0 消费者1 _ / 127.0.0.1

Expected Result -->(See the Owner COlumn)

GROUP                          TOPIC                          PARTITION  CURRENT-OFFSET  LOG-END-OFFSET  LAG             OWNER
console-consumer-81434         CT9                            0          1               1               0               **consumer-1_**/127.0.0.1
console-consumer-81434         CT9                            1          7               7               0               **consumer-2_**/127.0.0.1
console-consumer-81434         CT9                            2          1               1               0               **consumer-3**_/127.0.0.1
console-consumer-81434         CT9                            3          3               3               0               **consumer-4**_/127.0.0.1
console-consumer-81434         CT9                            4          5               5               0               **consumer-5**_/127.0.0.1

0 个答案:

没有答案