fluent-plugin-kafka
fluent-plugin-kafka copied to clipboard
fluent
Kafka input and output plugin for Fluentd
### Is your feature request related to a problem? Please describe. It seems like there is no way to pass environment variables for kafka_configs hash in rdkafka_group input. for example:...
### Describe the bug Hi team, After upgrade td-agent from 1.2.6 to 4.3.0, zookeeper and output_data_type in my td-agent template are not used. I searched on the internet but there...
### Describe the bug Team, Requesting your help to setup secure communication with SSL from Log aggregator (td-agent) to kafka broker, but getting error each time. ` @type kafka2 brokers...
### Describe the bug I have Fluentd forwarding messages to 6 kafka brokers. After crash of single broker, 1/6 of produces will fail: ``` 2022-06-13 09:26:24 +0000 [warn]: #1 [out_kafka_access]...
### Is your feature request related to a problem? Please describe. If I have a wildcard `` for `@type kafka2`, it would be great to have a way for `topic_key`...
In configuration it would be great to see a wildcard support for topics. For example: * `example*` - listens on all topics with the name beginning with "example". * `*`...
Hi there. When we add partitions to a topic, fluent-plugin-kafka doesn't detect these changes and doesn't start consuming messages from new partitions. We use kafka_group. As the workaround we just...
I use fluentd to send json log to sasl_ssl cloudera kafka , but I meet the following warn. So it cause send failed. I have verified my keytab and principal...
Hi there, I see there is a parameter `options[:trail]` right here in [ConsumerGroup](https://github.com/bsm/poseidon_cluster/blob/17f372ff2c351841f84eecd88774785386f244b5/lib/poseidon/consumer_group.rb#L94). Which is used to skip all the old messages in a specific topic. It's very useful if...
Can the topic key be a comma separated list of topics so that it produces to multiple topics?
