registry icon indicating copy to clipboard operation
registry copied to clipboard

Existing Kafka Topic Migration Tool

Open harshach opened this issue 7 years ago • 2 comments

Most often users ends up writing json or some other format into a topic. If they want to migrate this data into Avro encoded format supported by registry they end up writing their own consumer/producer tool to do this. This issue aims to provide a tooling to make this easier for users.

harshach avatar Jul 18 '17 18:07 harshach

@harshach KafkaAvroSerDesApp supports json to avro by taking records from a data file. Do we want to enhance that to take records from existing topics and push those into target topic with the required transformation from json(or any other format) to avro?

satishd avatar Jul 19 '17 09:07 satishd

they end up writing their own consumer/producer tool to do this

KSQL can be used to do this fairly simply

OneCricketeer avatar May 12 '18 03:05 OneCricketeer