kafka
kafka copied to clipboard
消费者无限Rebalance
目前出现了两次,突然间就不消费了。 打开kafka的server log: [2020-05-30 00:00:00,004] INFO [GroupCoordinator 0]: Preparing to rebalance group UserCenterProd in state PreparingRebalance with old generation 45617525 (__consumer_offsets-25) (reason: Updating metadata for member Easyswoole-kafka-42496b59-1170-487b-8b2a-21d8d460d2e9) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,005] INFO [GroupCoordinator 0]: Stabilized group UserCenterProd generation 45617526 (__consumer_offsets-25) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,005] INFO [GroupCoordinator 0]: Assignment received from leader for group UserCenterProd for generation 45617526 (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,012] INFO [GroupCoordinator 0]: Preparing to rebalance group UserCenterProd in state PreparingRebalance with old generation 45617526 (__consumer_offsets-25) (reason: Updating metadata for member Easyswoole-kafka-42496b59-1170-487b-8b2a-21d8d460d2e9) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,012] INFO [GroupCoordinator 0]: Stabilized group UserCenterProd generation 45617527 (__consumer_offsets-25) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,012] INFO [GroupCoordinator 0]: Assignment received from leader for group UserCenterProd for generation 45617527 (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,019] INFO [GroupCoordinator 0]: Preparing to rebalance group UserCenterProd in state PreparingRebalance with old generation 45617527 (__consumer_offsets-25) (reason: Updating metadata for member Easyswoole-kafka-42496b59-1170-487b-8b2a-21d8d460d2e9) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,019] INFO [GroupCoordinator 0]: Stabilized group UserCenterProd generation 45617528 (__consumer_offsets-25) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,019] INFO [GroupCoordinator 0]: Assignment received from leader for group UserCenterProd for generation 45617528 (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,025] INFO [GroupCoordinator 0]: Preparing to rebalance group UserCenterProd in state PreparingRebalance with old generation 45617528 (__consumer_offsets-25) (reason: Updating metadata for member Easyswoole-kafka-42496b59-1170-487b-8b2a-21d8d460d2e9) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,025] INFO [GroupCoordinator 0]: Stabilized group UserCenterProd generation 45617529 (__consumer_offsets-25) (kafka.coordinator.group.GroupCoordinator) [2020-05-30 00:00:00,026] INFO [GroupCoordinator 0]: Assignment received from leader for group UserCenterProd for generation 45617529 (kafka.coordinator.group.GroupCoordinator)
里面这个UserCenterProd就是es启动的消费者组,其它客户端的消费者组都没有报问题。 后来我重新设置了这个消费者组的位移,服务才正常。
scala版本:2.12 kafka版本2.4