lucene icon indicating copy to clipboard operation
lucene copied to clipboard

Try using Murmurhash 3 for bloom filters

Open shubhamvishu opened this issue 1 year ago • 14 comments

Description

We are currently using Murmurhash 2(MurmurHash64.java) in the bloom filters implementation in lucene where we also have Murmurhash 3 (the latest one available in the MurmurHash family of hash functions) and provides better performance, avalanche effect etc. It provides 128-bit variant which Murmurhash 2 doesn't. This PR aims to use Murmurhash 3 with bloom filters and see if that helps.   Note : We are already using murmur hash 3 in BytesRefHash implementation (#6666)

  Next steps :

  • [DONE] Run luceneutil benchmarks and share the results

shubhamvishu avatar Dec 01 '23 16:12 shubhamvishu