Ray

Hey @mdraijer, make sure add in the chunk key `tag` in your Buffer section e.g. ``` # etc ```

Hey @mdraijer, note that only the `topic` parameter supports placeholders, `topic_key` and `default_topic` doesn't.

@mdraijer Agreed that we should update the documentation but it is in there https://github.com/fluent/fluent-plugin-kafka/blob/master/lib/fluent/plugin/out_kafka2.rb#L18

Looks like neither `rdkafka` nor `ruby-kafka` supports this out of the box unfortunately.

Hey @brsolomon-deloitte, we should be able to achieve the same effect by using the `topic` parameter e.g. ``` # etc topic "${tag}" # etc ``` The `topic` parameter is not...

Hey @pchheda-lyft thanks for reporting this. I am able to reproduce this with the following config ``` @type sample sample {"hello": "world"} rate 7000 tag sample @type kafka2 brokers "broker:29092"...

Looking at `ruby-kafka` source code https://github.com/zendesk/ruby-kafka/blob/292f2d5a5b8ef4572485617121bf61a6725414cf/lib/kafka/consumer.rb#L359, it looks like they are already triggering heartbeat after every batch, so I don't think this change will yield any behavioural differences. From what...

Hey @vishalmamidi This does not sound like an issue related to the Kafka plugin, but rather specific to your OpenSearch setup. Perhaps you could look into your index mapping and...

> Instead of creating a new repository, adding a new gemspec file might be enough for this. Ah yeah, that will probably be the simpler option! > Another option is...

Hey @ashie, as far as I can tell, the only reason for monkey patching the `close` method is so that we can have a hard timeout when closing rdkafka's producer...