Accept data from Kafka

[laneholloway]

Data Prepper can receive events from Kafka using a source which acts as a Kafka consumer.

This source should support most or all of the consumer configurations.

It should be able to support deserializing objects directly into Events. With the StringDeserializer it can create an Event with a single field, say message with the string as the value. It could possible have a JSON-based deserializer which maps JSON data directly into the fields of the Event.

[srakshit]

I'm waiting for the feature when Data Prepper can talk to Kafka/MSK.

[ryn9]

Would like to see Kafka as both and input and a sink

[dlvenable]

This is implemented and will be released in 2.4.