orga icon indicating copy to clipboard operation
orga copied to clipboard

Bloom filter sets

Open mappum opened this issue 5 years ago • 0 comments

A possible optimization for our set operations are to use Bloom filters - we can probabilistically detect intersections in a way where the common case of 0 intersections is much faster to detect since we only have to AND the bits rather than doing O(N) HashSet lookups.

See more about this in the concurrency document: https://github.com/nomic-io/orga/blob/master/docs/concurrency.md#optimized-set-operations

mappum avatar Nov 10 '19 03:11 mappum