confluent-kafka-python icon indicating copy to clipboard operation
confluent-kafka-python copied to clipboard

Guidance on standalone consumer implementation

Open pdonorio opened this issue 8 months ago • 2 comments

Hi, we are trying to implement what is suggested in https://medium.com/@ravisharma911993/kafka-broadcasting-messages-without-consumer-groups-5a374fcfb7bc - a standalone consumer.

The use case: we have dynamic pods coming alive consuming from latest, die and not set any offset.

This would require, among other things, to set the group id to empty/none. Based on the post this is ok in Java, but in python we get

Failed to subscribe to topics: KafkaError{code=_UNKNOWN_GROUP,val=-179,str="Failed to set subscription: Local: Unknown group"}

Are there any plan to support this use case? What is the current reason we do not allow for empty group?

Thank you 🙏

pdonorio avatar Apr 04 '25 08:04 pdonorio