paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Bug] Convert timestamp_ltz field contents using local time zone

Open rfyu opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I searched in the issues and found nothing similar.

Paimon version

0.8

Compute Engine

flink

Minimal reproduce step

  1. Create a mysql table containing the timestamp type, and specify the time zone for mysql server to be UTC+8
  2. Use flink-cdc to import the data of the table into kafka
  3. Create a paimon table, which uses a timestamp_ltz type field to store the value of the timestamp type field in mysql
  4. If you query the paimon table in UTC+8, you will find that there are still 8 hours missing

What doesn't meet your expectations?

The content of the timestamp_ltz field retrieved from the Paimon table should be the same as in mysql

Anything else?

I think the root cause is that we use the utc time zone to read the data from kafka, but use the current time zone to write the data to paimon.

image image

Are you willing to submit a PR?

  • [X] I'm willing to submit a PR!

rfyu avatar Aug 22 '24 04:08 rfyu