fluent-plugin-kafka

fluent-plugin-kafka copied to clipboard

Output with kafka2 cannot dynamically define topic

4

### Describe the bug When I add this to the match-tag (@type kafka2): ``` topic_key topic_${tag[0]}_${tag[1]} ``` then the topic name is set to the literal string `topic_${tag[0]}_${tag[1]}`. Also the...

mdraijer

Fixes https://github.com/fluent/fluent-plugin-kafka/issues/462 Additionally, I just realised there's also a slight behavior change made in https://github.com/fluent/fluent-plugin-kafka/pull/454. Prior to that commit, we were fetching Kafka topic related metadata only for the given...

raytung

Newly introduced share_producer setting in 0.18.0 for out_kafka2 plugin results in BufferOverflowError

2

### Describe the bug Producing to Kafka works as expected, with 0.17.5 However, with 0.18.0, producing to Kafka results in BufferOverflowError (essentially less performant?). This is true if share_producer setting...

pchheda-lyft

in_kafka_group: send heartbeat if necessary

1

We've spotted that processing a batch of Kafka messages in fluentd sometimes takes a long time and because of that Kafka consumer groups go into a constant rebalancing state. Fluentd...

GiedriusS

### Describe the bug Fluent-bit failed to connecting to the Kafka brokers using Self Signed certs. [2022/08/10 20:26:54] [error] [output:kafka:kafka.1] fluent-bit#producer-2: [thrd:ssl://kafka2-xxxxxxx:xxxx/bootstrap]: ssl://xxxxxxxxx:xxxxxx/bootstrap: SSL handshake failed: ../ssl/statem/statem_clnt.c:1914: error:1416F086:SSL routines:tls_process_server_certificate:certificate verify...

rameshar16

kafka message getting rejected at OpenSearch when JSON message contains field names "message" in fields

2

### Describe the bug Kafka messages are getting rejected at OpenSearch when there is a field named message in the JSON Kafka message. ### To Reproduce not facing issue with...

vishalmamidi

rdkafka 0.12.0 is incompatible with fluent-plugin-kafka v0.18.0 or former

5

### Describe the bug We noticed a null pointer exception when td-agent is being restartet. But so far everything is working properly, no side effects , just this exxception stracktrace....

bertpassek

fluent-input-kafka use ssl error: SSL_CTX_use_certificate: ca md too weak

2

### Describe the bug we use fluent to consume kafka messages with ssl cert , fluent start with error below: 2022-01-12 15:00:45 +0800 [error]: #0 unexpected error error_class=OpenSSL::SSL::SSLError error="SSL_CTX_use_certificate: ca...

ly123-liu

Please enhance kafka2 output plugin to support ssl_client_cert_key_password

3

### Is your feature request related to a problem? Please describe. In our environment we prefer to use TLS private keys for client certificates that are protected with a password....

awulms-swift

Fluent-plugin-kafka is not able to connect to kafka brokers. Openssl error : dh key too small

1

### Describe the bug When connecting to kafka broker to send the logs, I am getting the following error. 2022-06-24 12:48:02 +0000 [warn]: failed to flush the buffer. retry_times=25 next_retry_time=2022-06-24...

vijeyanidhi