Michael McCandless

Results 335 comments of Michael McCandless

> > But understanding why supposedly equivalent expressions yield such a different benchmark result remains ... > > The expression `((int) A) >>> 1 + ((int) B) >>> 1` is...

Thanks for the reminder @shubhamvishu! > I'm seeing some crazy speedups for some tasks in the benchmarks (including `PKLookup`; a few got little slower) when using the new expression. Hmm...

> > I'm seeing some crazy speedups for some tasks in the benchmarks (including `PKLookup`; a few got little slower) when using the new expression. > > Hmm did you...

I think this is a nice overall approach, adding a new `RerankKnnFloatVectorQuery` that wraps a KNN query that used quantization to get the initial results. It's reminiscent of Lucene's existing...

Thanks @gsmiller! Maybe we should also separately add to the nightly tasks so nightly benchy can catch regressions? We can do that separately (and I agree we should, also separately,...

> * This proposal has an added side-benefit of de-duplicating vectors _within_ a field as well (if the features used for vector generation are identical across two documents) This is...

These are awesome results @kaivalnp! And this was only 200K docs -- with larger indices would the gains be more or less? Also, it's quite disturbing that even at a...

Thanks @Shibi-bala -- I agree it's odd it was scoped to just `DirectoryReader` -- any `IndexReader` should work as long as it can `openIfChanged` on itself. I think `English.java` (from...

Maybe start with a more bite-sized usage of async IO in Lucene? E.g. there have been discussions about approximate KNN algorithms that use a fast, highly quantized first pass, relying...

Oh yeah the async IO for KNN rescoring was first (that I saw!) mentioned in [this issue](https://github.com/apache/lucene/issues/12615).