fluent-plugin-kafka

fluent-plugin-kafka copied to clipboard

### Describe the bug We have implemented fluentd-kafka plugin to collect information from kafka topics and post the formatted data to Elastic search database. However, recently, after upgrading from kafka-6.0.0-1090...

phanitejak

fix(out_rdkafka2): fix compatibility with rdkafka 0.12.0

3

Fixes https://github.com/fluent/fluent-plugin-kafka/issues/463 I think this is the simplest implementation that I could find to support rdkafka 0.12.0, but unfortunately because of how we're monkey patching the methods, it means we'd...

raytung

…to 0.12.0 Signed-off-by: Ray Tung

raytung

In kafka group plugin is leaking memory incase of kafka is not reachable and disable retry limit is true.

srikanthbirada

Errors while sending data to Eventhub

1

### Describe the bug When I am trying to use out_kafka2 and send logs to eventhub which has 200 partitions, I am facing this issue: ``` 2023-12-01 22:56:45 +0000 [warn]:...

dipendra-singh

ruby-kafka is no longer maintained and superseded by librdkafka via rdkafka-ruby bindings

5

### Describe the bug I just wanted to raise to your attention that based on the official statement from the ruby-kafka repo: > This library is no longer actively developed...

mensfeld

out_kafka2: Broker pool to take care of fetching metadata

1

Which issue(s) this PR fixes: https://github.com/fluent/fluent-plugin-kafka/issues/502 What this PR does / why we need it: On enabling the get_kafka_client_log true, this can be figured out the leader of partitions is...

dipendra-singh

Bumps [actions/stale](https://github.com/actions/stale) from 8 to 9. Release notes Sourced from actions/stale's releases. v9.0.0 Breaking Changes Action is now stateful: If the action ends because of operations-per-run then the next run...

dependabot[bot]

out_rdkafka2: enable idempotency for kafka producers

4

**Which issue(s) this PR fixes:** None. **What this PR does / why we need it:** In order to enable Idempotency for kafka producers, rdkafka allowes us to enable this. ([here](https://github.com/confluentinc/librdkafka/blob/master/CONFIGURATION.md/#L137))...

dipendra-singh

out_rdkafka2: add patch for new version of rdkafka

1

All PR are failing now because of rdkafka gem update. The current code works with rdkafka 0.12.0, and in 0.14.0 (there is no 0.13.0), the `Rdkafka::Producer` implementation has changed, no...

ttych