confluent-kafka-python
confluent-kafka-python copied to clipboard
Guidance on standalone consumer implementation
Hi, we are trying to implement what is suggested in https://medium.com/@ravisharma911993/kafka-broadcasting-messages-without-consumer-groups-5a374fcfb7bc - a standalone consumer.
The use case: we have dynamic pods coming alive consuming from latest, die and not set any offset.
This would require, among other things, to set the group id to empty/none. Based on the post this is ok in Java, but in python we get
Failed to subscribe to topics: KafkaError{code=_UNKNOWN_GROUP,val=-179,str="Failed to set subscription: Local: Unknown group"}
Are there any plan to support this use case? What is the current reason we do not allow for empty group?
Thank you 🙏