kafka-connect-file-pulse icon indicating copy to clipboard operation
kafka-connect-file-pulse copied to clipboard

Convert Record Timestamps into Avro Logical Date Type

Open schrieveslaach opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

In avro there is a logical type date:

A date logical type annotates an Avro int, where the int stores the number of days from the unix epoch, 1 January 1970 (ISO calendar).

And it should be possible to parse fields as dates and convert it into a compliant Avro record.

Describe the solution you'd like

It would be great if DateFilter provides a configuration option to get access to temporal fields to be able to parse a date into a Avro compatible logical date int.

Describe alternatives you've considered

I tried to convert timestamp into “number of days from the unix epoch, 1 January 1970” but I couldn't find a way express that as SCeL.

schrieveslaach avatar Sep 09 '24 08:09 schrieveslaach