kafka-connect-storage-common icon indicating copy to clipboard operation
kafka-connect-storage-common copied to clipboard

Partitioning with key

Open arezvani opened this issue 3 years ago • 1 comments

How can I partitioning with key? If I use fieldpartitioner, partition.field.name should be set to which value? And if I want to partitioning my data with key and hold just latest 10 minutes or 10 data for each key, what should I do?

arezvani avatar Aug 12 '22 19:08 arezvani

Field partitioner only inspects the value of each record.

Therefore, you'd need another transform, or stream processor before being able to partition after moving the key to the value. Or otherwise duplicate the key into the value during producer code.

OneCricketeer avatar Oct 20 '22 01:10 OneCricketeer