BlackLab icon indicating copy to clipboard operation
BlackLab copied to clipboard

Save memory by memory-mapping more files

Open jan-niestadt opened this issue 3 years ago • 0 comments

Maybe the terms file could be memory-mapped? The format would probably need to change for this.

If we integrate the forward index and content store with Solr, we will probably get this "for free", because the way Lucene deals with segment files seems to include memory-mapping on 64-bit JREs on Linux, see FSDirectory.open() (will use MMapDirectory).

jan-niestadt avatar Dec 15 '21 13:12 jan-niestadt