fluent-plugin-kafka icon indicating copy to clipboard operation
fluent-plugin-kafka copied to clipboard

ruby-kafka is no longer maintained and superseded by librdkafka via rdkafka-ruby bindings

Open mensfeld opened this issue 7 months ago • 5 comments

Describe the bug

I just wanted to raise to your attention that based on the official statement from the ruby-kafka repo:

This library is no longer actively developed and has been superseded by librdkafka via rdkafka-ruby bindings. While this library may still receive security patches and bug fixes, it is no longer recommended for production usage.

ruby-kafka has some critical errors that can lead to data loss. Even zendesk already switched to it with their other operations.

While I cannot replace it fully (rdkafka and waterdrop maintainer here) in this plugin because of my limited knowledge, I am happy to help you guys out :)

The downside is jruby - which is something that will have to be figured out.

To Reproduce

To reproduce or rather see, check the .gemspec

Expected behavior

I would expect this library to use one of the maintained and recommended Kafka gem.

Your Environment

Applies to any environment.

Your Configuration

Applies to any config.

Your Error Log

Irrelevant.

Additional context

Please close it if you feel this is not a bug and it should be raised as a discussion or something else. From my perspective it is a bug as it poses risk of data loss for the end users.

mensfeld avatar Nov 27 '23 08:11 mensfeld