kafka-go
kafka-go copied to clipboard
Kafka library in Go
**Describe the bug** We've hit an issue in production where we get a lot of unknown member ID errors. **Kafka Version** I'm using confluent's docker image: confluentinc/cp-kafka:6.2.1 **To Reproduce** I've...
👋 I have a question regarding some behavior I'm seeing with this library. Let's say I have a local kafka broker configured with `message.max.bytes=512` and I attempt the following: ```...
**Describe the bug** I am using [Reader](https://pkg.go.dev/github.com/segmentio/[email protected]#Reader) with `GroupID` defined to read a kafka topic. The topic is being created in parallel to reader start. Sometimes it happens reader joins...
Here is the definition of offsets fetch request: https://cwiki.apache.org/confluence/display/KAFKA/A+Guide+To+The+Kafka+Protocol#AGuideToTheKafkaProtocol-OffsetFetchRequest The response is a list of topic partition offset information. We used a map to store topic and the partition offset...
Currently, if `Writer` is in async mode, ie: `WriterConfig.Async == true`, any errors that occur when writing the messages to kafka are ignored. It would be nice for a variety...
**Describe the solution you'd like** A clear and concise description of what you want to happen.  here, the code will cause too many clients connect to the first broker...
I have written code according to [example_consumer_group_test.go](https://github.com/segmentio/kafka-go/blob/master/example_consumergroup_test.go). But there is a problem as the offset will not updated. So I cannot use kafka-consumer-groups.sh to obtain the CURRENT-OFFSET. I think the...
**Describe the solution you'd like** When using consumer groups, it appears that the consumer name is not set dynamically. Specifically: - If kafka-go is taking over a consumer group that...
**Describe the solution you'd like** Once #223 is merged, we can add support for Oauth authentication. **Supporting documentation** https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=75968876 https://docs.confluent.io/current/kafka/authentication_sasl/authentication_sasl_oauth.html
**Describe the solution you'd like** Seeking to the end of a partition is probably broken for users that write messages with transactional producers. Because we're not setting the isolation level...