amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Bug]: data-expire obtained upperbound time is 8 hours later than the data time.

Open Aireed opened this issue 6 months ago • 1 comments

What happened?

id	name	ts	dt
3	name-3	2023-12-22 14:30:45	2023-12-22
4	name-4	2023-12-22 14:30:45	2023-12-22
5	name-5	2023-12-22 14:30:45	2023-12-22
2	name-1	2023-12-22 14:30:45	2023-12-22
6	name-6	2023-12-22 14:30:45	2023-12-22
Time taken: 0.474 seconds, Fetched 5 row(s)

Image

upperbounds of file: 2023-12-22T22:30:45+08:00, real timestamp is 2023-12-22 14:30:45 Image

Affects Versions

master

What table formats are you seeing the problem on?

Mixed-Hive

What engines are you seeing the problem on?

AMS

How to reproduce

1、create a mixed_hive table with data-expire properties like below Image 2、use spark engine to insert into records with ts which less than 1 minute from the current time 3、restart ams , and check the data whether is expire

Relevant log output


Anything else

No response

Are you willing to submit a PR?

  • [x] Yes I am willing to submit a PR!

Code of Conduct

  • [x] I agree to follow this project's Code of Conduct

Aireed avatar Jun 13 '25 09:06 Aireed

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

github-actions[bot] avatar Dec 11 '25 00:12 github-actions[bot]