iceberg icon indicating copy to clipboard operation
iceberg copied to clipboard

Flink Support for TIMESTAMP_NANOS data type for PARQUET

Open rodmeneses opened this issue 1 year ago • 1 comments

only includes changes to support timestamp_nanos on Flink for PARQUET. AVRO can be done in a new PR looks like ORC doesn't support NANO precision

rodmeneses avatar Oct 17 '24 22:10 rodmeneses

Do the schema conversions handle the nano ts correctly? Do we get a Timestamp(9) when we convert to Flink schema, or a nano timestamp when we convert from the Iceberg schema?

pvary avatar Oct 18 '24 05:10 pvary

Do the schema conversions handle the nano ts correctly? Do we get a Timestamp(9) when we convert to Flink schema, or a nano timestamp when we convert from the Iceberg schema?

👍🏻

rodmeneses avatar Oct 22 '24 23:10 rodmeneses

There are several tests which are using DataGenerator to generate test data - do we want to add nanos to them?

pvary avatar Oct 23 '24 14:10 pvary

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the [email protected] list. Thank you for your contributions.

github-actions[bot] avatar Nov 24 '24 00:11 github-actions[bot]

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

github-actions[bot] avatar Dec 01 '24 00:12 github-actions[bot]