kafka-go
kafka-go copied to clipboard
segmentio
Kafka library in Go
Currently, I’m working with Kafka in a multi-region setup, where I use replica-placement configurations within topic settings. I developed an internal tool using the segmentio/kafka-go package to automate topic creation...
**Describe the solution you would like** Defining a new writer should preferably have an option for setting dialer. `w := &kafka.Writer{Dialer: dialer, ...}` Alt. have a helper when defining `Dial`...
https://kafka.apache.org/11/protocol.html#The_Messages_Heartbeat The V0 heartbeat response looks like: ``` Heartbeat Response (Version: 0) => error_code error_code => INT16 ``` The V1 heartbeat response looks like: ``` Heartbeat Response (Version: 1) =>...
Since FetchMessage is already reading messages from a fetched batch, this new method just hold the messages util the batchSize number of messages are read. Fixes #123
fix: #1368 This handles startOffset when there's no consumer group set.
**Describe the bug** While debugging a high CPU consumption in my project, I noticed that each time an event is sent to Kafka, the number of goroutines running in my...
The `address` parameter is ignored in Dialer.DialPartition, since the address is provided in the Partition struct. I think it is confusing and should be removed. https://github.com/segmentio/kafka-go/blob/master/dialer.go#L140
**Describe the solution you would like** There are 160 open issues and 70 PRs not reviewed. I myself created bugs and PRs more than 1/2 year ago and got little...
**Describe the solution you would like** Currently the implementation when spinning a consumer without consumer group will always start at the first offset: https://github.com/segmentio/kafka-go/blob/a558bb8629a8f5a920a8e1bb640064ad7efb7cd8/reader.go#L707 Would it be possible to support...
Currently DefaultTransport refreshes on its own every 6seconds, but during this 6 seconds incase any kafka cluster activity is ongoing that involves broker refresh, client applications has outdated meta response,...
