dqlite icon indicating copy to clipboard operation
dqlite copied to clipboard

Dynamic trailing computation

Open marco6 opened this issue 4 months ago • 2 comments

This PR adds a non-default strategy to dynamically compute the amount of entries to keep in memory based on the size of the snapshot.

The problem with using a fixed number is that each entry has a different size (depending on the number of pages written for each transaction). As such, the memory used (and then streamed to a lagging follower) might be way bigger than the size of the snapshot itself (even by order of magnitude).

marco6 avatar Oct 18 '24 09:10 marco6