kafka-go

kafka-go copied to clipboard

We often receive incomplete bug reports, a lot of back and forth is needed just to get to being able to reproduce the issues, and often times the problems come...

achille-roussel

Way to get batch messages and commit if the batch is successful

23

There is no way to implement the below flow 1. Read batch messages from Kafka. 2. Process all the messages. 3. If all messages processing succesful - Commit the offset...

sanchitlohia-ovo

Reading topic partitions stopped at specific offsets

14

We use kafka 2.6 & segmentio v0.4.12 (but we reproduce this issue on master branch too). We are consuming a topic having 10 partitions with a simple program called avro-reader...

OhohLeo

Based on #855, this package adds two new primitives to support indexing Kafka partitions by message keys: `records.Index` and `records.Partition`. `records.Index` is an interface intended to serve as an abstraction...

achille-roussel

**Describe the solution you'd like** We spend a lot of time asking users for reproducible snippets; maybe we can improve or issue template to get to this quicker.

achille-roussel

## kafka-go/records I'm opening this PR to submit a suggestion to add a new package for higher-level components built on top of the kafka-go client APIs. In a similar way...

achille-roussel

Offset for consumer group

10

Hey everyone, I'm actually trying to use kafka-go using `Reader` and consumer group. I did not find a way to know what is the **last offset of the partition** attributed...

maeglindeveloper

batch.ReadMessage/Close fail with ErrUnexpectedEOF

10

**Describe the bug** When setting a read deadline on a connection [batch.ReadMessage](https://godoc.org/github.com/segmentio/kafka-go#Batch.ReadMessage) sometime fails with a ErrUnexpectedEOF. I based my code on [reader.read](https://sourcegraph.com/github.com/segmentio/kafka-go@master/-/blob/reader.go#L1914-1975), my goal is to make the equivalent...

vrischmann

Stuck Write Message when there is a issue "multiple Read calls return no data or error"

10

I have a strange issue Reproduce Steps: 1) I call w.WriteMessages(ctx, msgs...) 2) I have an error "multiple Read calls return no data or error" 3) I call w.WriteMessages(ctx, msgs...)...

anhtuanluu36

A way to retrieve what partitions where consumer is signed

3

Hi everyone! Some way to provide information of what partitions this client is signed. I think can be a method inside ReaderKafka like this: ```go r := kafka.ReaderConfig{ Brokers: []string{"localhost:9092"},...

romani-felipe