Backing up String key and Avro Value to Azure blob storage

[0rainingdays0]

I am trying to implement a backup(using secor) and restore(kafka producers) feature for taking continuous back up of our kafka cluster and restore feature to restore the topics when we need to create a new cluster. Since most of our topics use String key and Avro data. I tried to use Parquet Avro output format. But this is not taking backup of the topic key. To clarify -- Does secor provide any option to backup key while using avro -- If yes how can I achieve that

[HenryCaiHaiying]

I think by default most of the output format will only handle the value portion. If you want the key portion, you might need to overwrite the AvroParquetFileReaderWriterFactory to take in message key. You can take a look at MessagePackSequenceFileReaderWriterFactory to see how it uses message's key.