TileDB icon indicating copy to clipboard operation
TileDB copied to clipboard

Maximum fragment size consolidation parameter

Open gatesn opened this issue 4 years ago • 2 comments

There's an example in the docs of how consolidation can somewhat approximate LSM trees.

It would be helpful when operating in such a mode (consolidating after every write) to define a maximum fragment size preventing overly expensive consolidation. More expensive / unbounded consolidation can then be run manually at another time.

gatesn avatar May 26 '21 09:05 gatesn

Also having a dry-run mode would be really useful to experiment with consolidation parameters

gatesn avatar May 26 '21 16:05 gatesn

Thanks for raising this, it is already in our roadmap.

stavrospapadopoulos avatar Jun 10 '21 20:06 stavrospapadopoulos