Zeno
Zeno copied to clipboard
More efficient deduplication hash table
This is quite a half-baked idea, but we'd be looking to implement some sort of hit counter for items in the hash table, allowing us to clean it up when we've filled it up. This will also allow us to set a size "cap" on the table, helping during larger runs.
- [ ] Hit counter and removal of items with low number of hits when we're running low on space
- [ ] File based storage of the hash table (somehow...)