kafka-go
kafka-go copied to clipboard
segmentio
Kafka library in Go
This change adjusts the `Reader` to simply retry on `io.ErrNoProgress` rather than treating as an error/failure. Since there may not always be data to consume immediately, it seems sensible to...
**Describe the bug** We have 2 different topics on our kafka cluster. Both have multiple partitions, and both see millions of messages per day, with one of them almost hitting...
Static membership requires setting of group.instance.id, which requires JoinGroup API key version 5 and Heartbeat API Key version 3. [Documentation](https://kafka.apache.org/protocol.html#The_Messages_JoinGroup) Validation of new member.id is changed in later releases. When...
**Describe the solution you would like** I can see `aws-go-sdk-v1` is used to have authentication with MSK. I think it's good to add a support of [aws-go-sdk-v2](https://github.com/aws/aws-sdk-go-v2). I love to...
**Describe the bug** > `kafka.NewConsumerGroup` can't automatically create **groupid** on aws cloudwatch **Kafka Version** > * kafka 2.6.2 > * kafka-go v0.4.32 **To Reproduce** ```go package main import ( "github.com/segmentio/kafka-go"...
**Static Membership** Since kafka 2.3 it has been possible to use static membership across multiple group generations. Meaning that if a consumer goes down, a rebalance does not occur right...
sarama supports [following SASL mechanisms](https://github.com/Shopify/sarama/blob/master/broker.go): - PLAIN - SCRAM - GSSAPI(Kerberos V5) - OAUTH10A or OAUTHBEARER (I'm not sure which one) kafka-go doesn't support GSSAPI and OAUTH currently. I wish...
Creating a `kafka.Writer` directly seems to be much more complex that calling `NewWriter`. For example, it puts into place sensible defaults, makes setting up the `kafka.Dialer` for TLS really easy....
**Describe the solution you would like** v0.4.18 added [this feature](https://github.com/segmentio/kafka-go/pull/716), but it would be nice to be able to disable this new feature. In our use case, we care a...
