raft
raft copied to clipboard
rapidsai
Add FAISS with RAFT enabled Benchmarking to raft-ann-bench
- [x] RMM pooled resource for RAFT enabled FAISS
- [x] Update yaml config for
faiss_gpu_ivf_flat,faiss_gpu_ivf_pq - [x] Small fix FAISS GPU IVFPQ params
- [x] Update
get_faiss.cmake - [x] Fix SIGSEGV
Notes: The StandardGpuResources object is part of FAISS' index classes. As a result, there is no way of creating a separate Raft handle for each thread without creating a new instance of the whole index object for a new thread. As such, multi-threaded benchmarking for GPU indices will not work.
For CPU indices, @divyegala had seen some other issues. Though this PR is mainly about raft-enabled FAISS GPU indices.
![copy-pr-bot[bot] avatar](https://avatars.githubusercontent.com/in/354886?v=4 "Published by a pub.dev verified publisher"){kind=small}
