paimon
paimon copied to clipboard
[compaction] Filter out invalid splits to improve flink database compaction efficiency
Purpose
Linked issue: close #xxx Filter out invalid splits to improve flink database compaction efficiency
(1) Referring to the pickFullComparison method of CompactStrategy, filter out whether dataFiles is empty or all files in dataFiles are at the max-level