amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[Feature]: Support finer-grained optimization under partitioning

Open upczsh opened this issue 1 year ago • 0 comments

Description

Currently, Amoro's optimization process is based on partitions. When the table has not been optimized, there may be a large number of small files in the partition, and optimization resources will be occupied for optimization. I hope to optimize the content under the table partition in a more fine-grained manner. For example, optimize small files generated within an hour. Such as : f93caebea9e68f6535f4c3afd24a15ad

Use case/motivation

No response

Describe the solution

No response

Subtasks

No response

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

upczsh avatar Oct 12 '24 12:10 upczsh