升级后Kafka Consumer不消费消息

时间:2017-10-12 21:55:52

标签: go apache-kafka kafka-consumer-api sarama

我使用Go并将服务器升级到kafka 0.11并将sarama客户端升级到v1.13.0。我现在也在使用sarama-cluster代替wvanbergen / kafka进行消费者群体管理。 请注意,kafka升级适用于wvanbergen / kafka和旧版sarama客户端(v1.8)

我看到我的消费者没有消费任何消息,并且日志中有一行说消费者群体已经死亡。

以下是kafka日志:

2017-10-12 19:39:05,030 - INFO  [kafka-request-handler-7:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group job_event_consumer with old generation 0 (__consumer_offsets-5)
2017-10-12 19:39:05,032 - INFO  [kafka-request-handler-3:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group user_forwarder with old generation 0 (__consumer_offsets-20)
2017-10-12 19:39:08,031 - INFO  [executor-Rebalance:Logging$class@70] - [GroupCoordinator 1]: Stabilized group job_event_consumer generation 1 (__consumer_offsets-5)
2017-10-12 19:39:08,032 - INFO  [executor-Rebalance:Logging$class@70] - [GroupCoordinator 1]: Stabilized group user_forwarder generation 1 (__consumer_offsets-20)
2017-10-12 19:39:08,032 - INFO  [kafka-request-handler-5:Logging$class@70] - [GroupCoordinator 1]: Assignment received from leader for group job_event_consumer for generation 1
2017-10-12 19:39:08,033 - INFO  [kafka-request-handler-5:Logging$class@70] - [GroupCoordinator 1]: Assignment received from leader for group user_forwarder for generation 1
2017-10-12 19:39:15,743 - INFO  [kafka-request-handler-1:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group user_forwarder with old generation 1 (__consumer_offsets-20)
2017-10-12 19:39:15,744 - INFO  [kafka-request-handler-2:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group job_event_consumer with old generation 1 (__consumer_offsets-5)
2017-10-12 19:39:45,743 - INFO  [executor-Rebalance:Logging$class@70] - [GroupCoordinator 1]: Stabilized group user_forwarder generation 2 (__consumer_offsets-20)
2017-10-12 19:39:45,744 - INFO  [executor-Rebalance:Logging$class@70] - [GroupCoordinator 1]: Stabilized group job_event_consumer generation 2 (__consumer_offsets-5)
2017-10-12 19:39:47,043 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Member mothership_staging-2c8c20d0-4a6b-4b41-b208-e822553bc9c7 in group user_forwarder has failed, removing it from the group
2017-10-12 19:39:47,044 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group user_forwarder with old generation 2 (__consumer_offsets-20)
2017-10-12 19:39:47,272 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Member mothership_staging-31a167c1-f70e-4af6-a21d-da500149c084 in group job_event_consumer has failed, removing it from the group
2017-10-12 19:39:47,272 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Preparing to rebalance group job_event_consumer with old generation 2 (__consumer_offsets-5)
2017-10-12 19:40:15,743 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Member mothership_staging-7c1655dc-a7bc-4d39-b632-9af33c7ba934 in group user_forwarder has failed, removing it from the group
2017-10-12 19:40:15,744 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Group user_forwarder with generation 3 is now empty (__consumer_offsets-20)
2017-10-12 19:40:15,745 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Member mothership_staging-6ef84d2e-fca7-4c7c-920f-2b0d4ef8ec86 in group job_event_consumer has failed, removing it from the group
2017-10-12 19:40:15,746 - INFO  [executor-Heartbeat:Logging$class@70] - [GroupCoordinator 1]: Group job_event_consumer with generation 3 is now empty (__consumer_offsets-5)
2017-10-12 19:44:11,330 - INFO  [group-metadata-manager-0:Logging$class@70] - [Group Metadata Manager on Broker 1]: Group job_event_consumer transitioned to Dead in generation 3
2017-10-12 19:44:11,331 - INFO  [group-metadata-manager-0:Logging$class@70] - [Group Metadata Manager on Broker 1]: Group user_forwarder transitioned to Dead in generation 3

消费者或任何其他日志中没有错误。 可能导致这个问题的原因是什么?

0 个答案:

没有答案