autofaiss
autofaiss copied to clipboard
criteo
Automatically create Faiss knn indices with the most optimal similarity search parameters.
I want to ask whether doing KNN search with torch tensors is supported? Many thanks!
I wanted to build IVF262144_HNSW32,SQ8, but the estimation of the required memory was way too big.
``` INFO:autofaiss: Computing best hyperparameters for index faiss_titles.faiss 05/05/2022, 07:16:53 WARNING:autofaiss:The maximum nearest neighbors coverage is 10.65% for this index. It means that when requesting 20 nearest neighbors, the average...
I have trained 3 different index and every time, my 1-recall@20 are exactly the same: INFO:autofaiss: 1-recall@20: 0.802 INFO:autofaiss: 1-recall@40: 0.824 But there is some variation in the 20-recall and...
Hello, I'm currently running a workflow in argo which is generating several embedding files, in parallel, based on a database search. If no data was found, the workflow returns a...
Hi, thanks to all maintainers of this project, that's a great tool to streamline the building and tuning of a Faiss index. I have a quick dumb question about the...
``` python 3.8.12 autofaiss 2.13.2 pypi_0 pypi faiss-cpu 1.7.2 pypi_0 pypi libfaiss 1.7.2 h2bc3f7f_0_cpu pytorch ``` First of all, thank you for the great project! I get the error: `module...
Hi! Thank you for the great project! Unfortunately I'm experiencing some issues, which could be caused by Windows (10 Pro) and I'm not sure how to solve them. I installed...
* building one index or a thousand indices from one embedding set has the same cost if doing one training and grouping at read time (allows doing one index per...
https://github.com/facebookresearch/faiss/wiki/Inverted-list-objects-and-scanners#the-invertedlistscanner-object this would require some c++ code, but it seems possible to have one stage filtering directly with faiss by overriding that scanner to add a masking feature (for example...