confluent-kafka-python
confluent-kafka-python copied to clipboard
Consumer. incremental_assign with different group id
How can I add and remove topic from consumption with different group id?
consumers are scoped to a particular group. you need a different consumer instance.
@mhowlett
in addition I would recommend confluent C lib developers to:
- use one connection for consumer, producer and admin. why do we need establish many socket connection from only node/app/service
- in consumer group.id must be related on topic, not on consumer initialisation. because consumption from topic related on partitions of the topic. so, it should look smth like consumer.subscribe(topic, groupId), consumer.unsubscribe(topic). otherwise (now) we must create new consumer instance for each topic with different groups that keeps new socket connection - not good architecture