confluent-kafka-go icon indicating copy to clipboard operation
confluent-kafka-go copied to clipboard

Static subscription works incorrectly

Open gromas opened this issue 1 year ago • 2 comments

Description

When consumer with static subscription reconnect to kafka cluster then it can't subscribe to required topics.

How to reproduce

Create consumer with group.instance.id "instance1" then subscribe to topic "topic1". Do poll some messages. Subscribe to topic "topic2" and do poll some message. Then do hard disconnect/application shutdown. Some time later restart consumer again with same sequence. After consumer subscribe to topic1 it poll messages from topic2 only not from topic1.

Workaround: Create a new static consumer on every restart [I use "group.instance.id": uuid.new().string()]

Checklist

Please provide the following information:

  • [x] confluent-kafka-go and librdkafka version (LibraryVersion()): v2.3.0
  • [ ] Apache Kafka broker version: any
  • [x] Client configuration: ConfigMap{...} "group.id": "group1", "group.instance.id": "instance1", "go.application.rebalance.enable": true, "enable.partition.eof": true, "enable.auto.offset.store": false, "enable.auto.commit": false
  • [x] Operating system: Ubuntu 22.04.3 TLS 64 bit @ Windows 11 hyper-v
  • [x] Critical issue

gromas avatar Feb 04 '24 17:02 gromas

If required I can attach source code for reproduce

gromas avatar Feb 04 '24 17:02 gromas

I'm sorry. I accidentally clicked the wrong button and closed it. Opened it again.

gromas avatar Feb 04 '24 17:02 gromas