DBSubsetter icon indicating copy to clipboard operation
DBSubsetter copied to clipboard

Decrease Memory Consumption of Primary Key Storage

Open bluerogue251 opened this issue 5 years ago • 1 comments

Similar in spirit to https://github.com/bluerogue251/DBSubsetter/issues/33, but for the Primary Key Store instead of the Pre Target Buffer.

Consider converting the In-Memory HashMap into a ChronicleMap to store these long-lived values off-heap.

bluerogue251 avatar Oct 26 '19 21:10 bluerogue251

Other options to explore in addition to Chronicle Map:

  • https://en.wikipedia.org/wiki/Lightning_Memory-Mapped_Database
  • https://en.wikipedia.org/wiki/LevelDB

bluerogue251 avatar Nov 05 '19 01:11 bluerogue251