Compactor icon indicating copy to clipboard operation
Compactor copied to clipboard

Skip frequently updated files

Open Freaky opened this issue 4 years ago • 4 comments

Files that get updated a lot, particularly if they're large, are poor candidates for compaction.

An obvious simple heuristic that seems likely to be relatively effective is to check file modification time, and simply have a configurable cutoff - if it's changed in the past n days, skip it. Tiering this by file size might also make sense - frequently decompressing and recompressing a small file is much less costly than a large one.

This sort of thing will be more important should Compactor migrate to a background system service with patrol compactions.

Freaky avatar May 04 '20 03:05 Freaky

Yeah, I was going to suggest this. Even without tiering an option to set this cutoff would be very useful.

alpe12 avatar Aug 04 '20 20:08 alpe12

@Freaky Please, take a look at adding this cutoff by modified time. Thanks.

alpe12 avatar Mar 01 '21 13:03 alpe12

Will be getting to it soon!

Freaky avatar Mar 01 '21 20:03 Freaky

What I said but really this time.

compactor-0 11-settings

Freaky avatar Dec 20 '22 18:12 Freaky