amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Improvement]: When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile.

Open lintingbin opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I have searched in the issues and found no similar issues.

What would you like to be improved?

The current data-expire feature cannot function properly when the iceberg table does not have metrics enabled or when the metrics are ineffective (i.e., the datafile does not record the upper_bound of the expiration field). Hoping to implement the data-expire feature in cases where metrics information is missing.

How should we improve?

When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile.

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

Subtasks

No response

Code of Conduct

lintingbin avatar Oct 17 '24 11:10 lintingbin