knowhere icon indicating copy to clipboard operation
knowhere copied to clipboard

todo: merge AVX-512 version of PQFastScan

Open alexanderguzhva opened this issue 10 months ago • 0 comments

Faiss PR https://github.com/facebookresearch/faiss/pull/3276

AVX-512 implementation for PQFastScan for QBS.
For local benchmarks on 4th gen Xeon, the QPS is up to 10% higher, mostly for a single query case. But as far as I remember, production cases would show higher performance improvements.

It cannot be cherry-picked or copy-pasted, because Faiss baseline uses #ifdef mechanism for deciding whether to use AVX-512, and Knowhere uses dynamic hooks. Some additional code is needed.

alexanderguzhva avatar Apr 18 '24 16:04 alexanderguzhva