Kafka消费者失败并突然退出消费者组

时间:2021-07-01 07:52:07

标签: apache-kafka apache-kafka-streams

Kafka 消费者尝试加入 Kafka 消费者组,但突然退出消费者组。

Kafka broker 日志确认该成员已加入群组。

[2021-06-25 19:47:25,612] INFO [GroupCoordinator 1002]: Preparing to rebalance group ABCDSTREAM in state PreparingRebalance with old generation 8 (__consumer_offsets-42) (reason: Adding new member ABCDSTREAM-7480b34a-6e44-4fdc-87ab-71655b9490f0-StreamThread-1-consumer-c75b5014-e853-4b7e-943b-f9873b5e061d with group instanceid None) (kafka.coordinator.group.GroupCoordinator)
[2021-06-25 19:47:25,613] INFO [GroupCoordinator 1002]: Stabilized group ABCDSTREAM generation 9 (__consumer_offsets-42) (kafka.coordinator.group.GroupCoordinator)
[2021-06-25 19:47:25,701] INFO [GroupCoordinator 1002]: Assignment received from leader for group ABCDSTREAMfor generation 9 (kafka.coordinator.group.GroupCoordinator)

但就在半分钟后,broker 日志显示由于心跳异常,消费者正在离开组。

[2021-06-25 19:47:41,859] INFO [GroupCoordinator 1002]: Member ABCDSTREAM-7480b34a-6e44-4fdc-87ab-71655b9490f0-StreamThread-1-consumer-c75b5014-e853-4b7e-943b-f9873b5e061d in group ABCDSTREAM has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-06-25 19:47:41,859] INFO [GroupCoordinator 1002]: Preparing to rebalance group ABCDSTREAM in state PreparingRebalance with old generation 9 (__consumer_offsets-42) (reason: removing member ABCDSTREAM-7480b34a-6e44-4fdc-87ab-71655b9490f0-StreamThread-1-consumer-c75b5014-e853-4b7e-943b-f9873b5e061d on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator)
[2021-06-25 19:47:41,859] INFO [GroupCoordinator 1002]: Group ABCDSTREAM with generation 10 is now empty (__consumer_offsets-42) (kafka.coordinator.group.GroupCoordinator)

流应用程序日志中发生以下事件:

<块引用>

从 CREATED 到 REBALANCING 的状态转换
从 CREATED 到 STARTING 的状态转换
订阅主题和分区作业
第 13 代完成小组作业
13代成功加入群组
从 STARTING 到 PARTITIONS_ASSIGNED 的状态转换

流应用程序日志没有显示任何行为,因为它被踢出代理中的消费者组。

有人熟悉类似的问题吗?如果需要更多信息,请告诉我。

0 个答案:

没有答案