fluent-plugin-kafka
fluent-plugin-kafka copied to clipboard
fluent
Kafka input and output plugin for Fluentd
### Describe the bug source is kafka , connect to kafka with kdc failed without ssl ### To Reproduce run fluentd with below config ### Expected behavior connect kafka success...
Hi Maintainers ! It is a pull request, to extend a current feature. It is possible for some inputs to inject kafka message headers into the message (merge). But for...
### Is your feature request related to a problem? Please describe. Expect a fluentd-plugin-rocketmq like fluentd-plugin-kafka ### Describe the solution you'd like Expect a fluentd-plugin-rocketmq like fluentd-plugin-kafka ### Describe alternatives...
### Is your feature request related to a problem? Please describe. Currently using fluent with AWS MSK as unauthenticated with security groups to control access. Want to enable AWS IAM...
### Describe the bug I've configured fluentd to fetch data from AWS MSK and transferring it to coralogix. Unfortunately, fluentd fails with the error **"SCRAM-SHA-512 is not supported"**. Note: msk...
### Describe the bug I have tried log level 6 and 7 for rdkafka2 but I cant see log messages that describe fluentd sending to kafka like below for example...
This is because msg_size_too_large and topic_authorization_failed error codes should be treated as an unrecoverable error. In Fluentd, we need to mark as unrecoverable with raise Fluent::Unrecoverable. But current implementation does...
### Describe the bug fluentd config gracefule reload. Warn logs have occurred. 2024-06-24 14:25:56 +0900 [warn]: unexpected error while shutting down on output plugin plugin=Fluent::Kafka2Output plugin_id="object:175c" error_class=NoMethodError error="undefined method `synchronize'...
This is a super simple proof-of-concept implementation for Waterdrop as described in https://github.com/fluent/fluent-plugin-kafka/issues/500. We'll need a lot more work to get this up to scratch compared to the other output...
1. fluent-plugin-kafka 0.18.1 2. fluentd 1.14.6 [error.log](https://github.com/user-attachments/files/17177426/error.log) According to the above error, I analyzed the reasons as follows： When Kafka does not have a topic to write to and does...
