franz-go
franz-go copied to clipboard
twmb
franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.6+. Producing, consuming, transacting, administrating, etc.
This PR follows the discussion in https://github.com/twmb/franz-go/issues/670. I added a new struct field, `mergeConnectsMeter bool` that is manipulated by `WithMergedConnectsMeter()`, to control whether to use one or 2 metrics to...
There used to be a typo (API Key 58 / Envelope instead of API Key 57 / UpdateFeatures). I'm not entirely sure what the "Envelope" API does, but I think...
We are running redpanda self-hosted with three brokers. Our app consume from 1 topic, process messages, and produce to 3 topics. Consuming and processing takes no times, but producing back...
Hi, The example from "Getting started" section is used, with following changes: seeds := []string{"192.168.2.80:9012"} cl, err := kgo.NewClient( kgo.SeedBrokers(seeds...), kgo.ConsumerGroup("tmp"), kgo.ConsumeTopics("test"), ) ... record := &kgo.Record{Topic: "test", Value: []byte("bar")}...
Hi, we use `AddConsumeTopics(foo)` to add new topics to the client dynamically. This works great. Unfortunately, we experienced redelivering of old messages once `PurgeTopicsFromConsuming(foo)` has been called after `AddConsumeTopics(foo)`. It...
https://github.com/twmb/franz-go/issues/591 According this, I think when records will be flushed when linger is hit or batch is full. ``` seeds := strings.Split(brokers, ",") cl, err := kgo.NewClient( kgo.SeedBrokers(seeds...), kgo.ProducerLinger(time.Second*10), kgo.MaxBufferedRecords(5),...
I just realised that the `kgo.RequestTimeoutOverhead()` is the default timeout for most of the requests. I didn't understand it just reading the doc, as I thought it was always an...
In this PR I'm proposing to add `req` field to 'read from broker errored' log. While investigating an incident, we had a case where such addition would have been helpful....
If a consumer that can be cooperative but is currently eager revokes its assigned partitions as part of a rebalance it should also clear its tracking state between rebalances as...
In [Mimir](https://github.com/grafana/mimir), we have a process creating 1 `Client` (setting `MetadataMinAge` = MetadataMaxAge = 10s`) and then using it to do two things: 1. Consume a partition 2. Request `ListOffsets`...