kafka-connect-storage-cloud icon indicating copy to clipboard operation
kafka-connect-storage-cloud copied to clipboard

Create possibility to use your own writer.

Open gotpist1 opened this issue 2 years ago • 1 comments

I think it would benefit a lot of people if there where a possibility to override the filename creation in TopicPartitionWriter with your own implementation. I have written my own partitioner, but i also need the files written to S3 to have another name.

My suggestion would be to add a FilenameCreator interface. In that way, one can add it's own implementation for generating a filename from the sink record. I will create a pull request for this.

gotpist1 avatar Feb 23 '23 10:02 gotpist1

I have created a PR for this! Would appreciate some comments :)

gotpist1 avatar Mar 18 '24 14:03 gotpist1