Alex Chi Z.
Alex Chi Z.
It is possible that a range of the data has accumulated too much history so that subcompaction cannot help in this case. > can I somehow prevent compaction from giving...
Our plan is to improve the job split algorithm to split on both key range and LSN so that it can create a job with fewer rewrites.
> I looked at the code. Currently, compaction and "manual" compaction are mixed together. In order to know if a compaction job is triggered manually and its metrics, I am...
I think it's possible and we can do it in the future. For now 1 compaction thread works fine for us because we have thousands of tenants per pageserver.
I moved the background loop structure to `common` for now. For other components (sk/storcon) we don't know the smallest unit we want to control for now (maybe timeline instead of...
Is the changes from your output? I'm currently investigating issues related to tier/level id, there might be some mismatches between the write-up and the actual code.
Hey -- we have updated docs wrt tiered compaction last year, and I guess all the issues should be fixed :) Thank you for the patch anyways!
Yes, I think the API change makes sense. I'd love to include it in the next major update of the course.
I feel it's more like a design choice whether to make a course step-by-step or a generic guidance of how to do a thing. One example is the write-up I...