kafka-go
kafka-go copied to clipboard
segmentio
Kafka library in Go
After using segmentio, why does the number of goroutines fluctuate and double occasionally? For example, the number of goroutines from 1:0 to 1:10 is 3000, then the number of goroutines...
**Describe the bug** While it is running, the Reader does not commit the consumer group offsets until it receives the first message on a partition. The result of this is...
Here is a sample code on what i am doing. My consumers are bound by GroupIDs. I fetch the message and do some business logic on top of it. It...
**Describe the solution you'd like** The Writer abstraction is a bad design when it comes to writing messages and batching. **Current System** Users call WriteMessages which takes N messages. The...
**Describe the bug** a reader, with group id specified, consumes from a topic with multiple partitions, did not get all the messages. Occasionally lost a few records. **Kafka Version** 1.0.2...
we recently added the error logger to the reader config for reader initialisation. Looking into the logs, these below type of error logs have been occurring quite frequently: **_`the kafka...
This PR implements GSSAPI/Kerberos support. I previously commented in PR #563 from my personal account (@mentalisttraceur) about how we also implemented GSSAPI/Kerberos support at Viasat and just hadn't yet had...
**Describe the solution you'd like** - [ ] Use kafka.Transport on Reader and ConsumerGroup - [ ] Address note about kafka.Balancer improvements https://github.com/segmentio/kafka-go/blob/0.5/writer.go#L1247-L1272 - [ ] Remove top-level compression package...
There are situations where a tls.Conn only reports an EOF which eventually bubbles up to the caller as an UnexpectedEOF. This error can occur for many reasons and makes debugging...
