kafka-go
kafka-go copied to clipboard
Kafka library in Go
Is there a way to set *max.in.flight.requests.per.connection* on the WriterConfig ? https://docs.confluent.io/platform/current/installation/configuration/producer-configs.html#producerconfigs_max.in.flight.requests.per.connection For us it is important since we need the order on a partition to be guaranteed. Kafka has...
### First issue ### we're often getting a reader error ~500k/day. ``` the kafka reader got an unknown error reading partition 9 of SOME_TOPIC at offset 3: read tcp IP_ADDRESS:46406->IP_ADDRESS:9093:...
**Describe the solution you'd like** A clear and concise description of what you want to happen. Consider the following steps * Use an async Writer to write messages to a...
Integrating the DurationStats and SummaryStats with prometheus is kind of difficult using the https://github.com/segmentio/stats library. Have you considered letting the user handle the integration manually? Something such as: ``` type...
I see that it is possible to reuse a buffer with Batch.Read(b []byte) but this can only be used with the low-level API. It would be nice to have the...
**Describe the bug** I'm testing the behaviour of the range group balancer for co-partitioning. My setup consists of a main topic `my-topic` and a hospital topic `my-topic_hospital`, each with 6...
Hello, My team is making use of this library's `kafka.Reader` object. My team wanted to do the equivalent of pinging the Kafka cluster before continuing with program execution -- we...
**Describe the solution you'd like** Currently, we have to re-create a Reader if we want to subscribe to a new topic, this is perfectly fine when only subscribed to a...
**Describe the bug** I updated the library to 0.4.16, and started getting the error "Unexpected EOF". I downgrade to 0.4.6 and 0.4.8, same problem. **Kafka Version** What version(s) of Kafka...
Exactly once
**Describe the solution you'd like** Company I work for is using kafka as one of ways to communicate between services and GO is one of core languages we use. We...