amoro icon indicating copy to clipboard operation
amoro copied to clipboard

feature: data-expire by partition info

Open lintingbin opened this issue 1 year ago • 0 comments

Why are the changes needed?

Close #3272.

Brief change log

  • When the expiration field is the partition field and the expiration level is partition, prioritize using the partition information of the datafile to expire the data files.

  • Modify the expected results of a test case, which is slightly different from the previous implementation. In partition expiration, date comparison is needed, and data files with the same date should not be expired.

How was this patch tested?

  • [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • [ ] Add screenshots for manual tests if appropriate

  • [x] Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

lintingbin avatar Oct 17 '24 12:10 lintingbin