franz-go

franz-go copied to clipboard

kgo.FetchMaxPartitionBytes: increasing this option causes high memory usage

2

We noticed that when increasing the value for _kgo.FetchMaxPartitionBytes_ even to **10MB**, causes our apps to use much more memory than normal. Also the throughput is affected. You can see...

sbuliarca

Kip-848: Next Generation Consumer Group

4

I wanted to know what is the plan on implementing KIP-848. I see a dedicated branch just for this, but it's been inactive for a year. @twmb I would be...

aratz-lasa

Clarification NoOffsetReset

2

I am having some trouble understanding exactly how NoResetOffset() works. I am working only with group consumers. My use case is that I want to set the default behaviour to...

esiqveland

- [x] Support Kafka 3.7 (as well as Errors.java) - [ ] Ready to merge: #672 - [ ] Ready to merge: #681 - [ ] Ready to merge: #697...

twmb

Max-Cheng

Batch and retry uncommitted records with group consumer and kotel

6

Hi, I have 2 issues, one with batch and retry of records using group consumer, the second with making `kotel` work. I'm trying to understand how can I configure Batch...

yakirSalt

Align connects metrics to prevent no data scenarios

3

Hello, while using this library and the `kotel` plugin for monitoring some consumers of Kafka clusters we noticed a pattern in the connection metrics that is creating some minor issues...

endorama

Scrolling through code I found mysterious constants, looks like this should be `codecType`. However, `codec` param is `byte` but `codecType` is `uint8` I don't think it's a problem. Changing function...

cristaloleg

Currently I am looking at multiple dynamic deployments of this library and I'm looking to implement checks prior to initialized polling which need to verify that the necessary topics have...

UnaffiliatedCode

pkg/kgo: allow marking using an offset

3

Currently when using `AutoCommitMarks` option the only function available for marking is `MarkCommitRecords(rs ...*Record)`, this requires you to keep `Record`s in memory until they're marked (possibly for prolonged periods of...

sudo-sturbia