kafka-go
kafka-go copied to clipboard
Kafka library in Go
Hi there, we are using this wonderful library, but are having trouble understanding how the fetcher works. It seems like the documentation lacks details on this. At the lowest library...
If we subscribe to multiple topics on one consumer, I want to be able to see the lag per topic, if we use GroupTopics the value isn't set and we...
Apparently, the closure should not capture the loop variable
Apparently, any elements in array variable apiTypes has been allocated, the nil check is redundant.
**Describe the bug** Consider the scenario ([P] = publisher, [R] = reader) [P] testtopic is created (empty) [R] new Reader is created with StartOffset: LastOffset => new ConsumerGroup initialized; with...
func main() { r := kafka.NewReader(kafka.ReaderConfig{ Brokers: []string{"localhost:9092"}, Topic: "my-topic", Partition: 0, MaxBytes: 10e6, // 10MB }) for { m, err := r.ReadMessage(context.Background()) if err != nil { break }...
**Describe the solution you would like** It would be good if Writer supported Transactional API. Currently the only mention of Transactional in this library is `Dialer`'s `TransactionalID` field. I have...
Second suggestion to fix issue https://github.com/segmentio/kafka-go/issues/1314 with no rebalance after consumer in consumer group receives empty assignment https://github.com/segmentio/kafka-go/issues/1314 Cause of the issue: 1. Topic is not created 2. assignPartitions not...
First suggestion to fix issue https://github.com/segmentio/kafka-go/issues/1314 with no rebalance after consumer in consumer group receives empty assignment https://github.com/segmentio/kafka-go/issues/1314 Cause of the issue: 1. assignTopicToPartition ignores error UnknownTopicOrPartition 2. Topic in...
**Describe the bug** >PartitionWatcher in the consumer group cannot track the creation of a topic. The problem occurs if the topic is created after JoinGroup, but before running PartitionWatcher. >...