kafka-connect-storage-common icon indicating copy to clipboard operation
kafka-connect-storage-common copied to clipboard

Ability to use epoch and to also specify the format of a RecordField when using TimeBasedPartitioner

Open bwilliams42 opened this issue 7 years ago • 4 comments

Hi. I added some functionality to use epoch seconds and to also specify the format of a RecordField when using TimeBasedPartitioner. For this I added two configuration attributes.

is.epoch can be true but defaults to false. timestamp.field.format which expects a java date format string.

I think it is useful and would like to share it. Thanks.

-BW

bwilliams42 avatar Nov 06 '18 17:11 bwilliams42

@confluentinc It looks like @bwilliams42 just signed our Contributor License Agreement. :+1:

Always at your service,

clabot

ghost avatar Nov 06 '18 17:11 ghost

@kkonstantine happy Wednesday.I'm pinging you as I'm not sure what the protocol is. So if this is incorrect i apologize and ask that you let me know what the preferred process is. Thanks.

bwilliams42 avatar Nov 07 '18 15:11 bwilliams42

AFAIK, this feature set is already possible by putting a TimestampConverter$Value ahead of the Sink connector

OneCricketeer avatar Dec 19 '18 20:12 OneCricketeer

AFAIK, this feature set is already possible by putting a TimestampConverter$Value ahead of the Sink connector

@cricket007 Thats true, but timestampConverter changes the value of the field. There may be cases where we don't want to update the field value and keep it in same format.

piyushkhetan avatar Dec 06 '19 12:12 piyushkhetan