amoro
amoro copied to clipboard
feature: data-expire by partition info
Why are the changes needed?
Close #3272.
Brief change log
-
When the expiration field is the partition field and the expiration level is partition, prioritize using the partition information of the datafile to expire the data files.
-
Modify the expected results of a test case, which is slightly different from the previous implementation. In partition expiration, date comparison is needed, and data files with the same date should not be expired.
How was this patch tested?
-
[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
-
[ ] Add screenshots for manual tests if appropriate
-
[x] Run test locally before making a pull request
Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)