big-ann-benchmarks
big-ann-benchmarks copied to clipboard
harsha-simhadri
Framework for evaluating ANNS algorithms on billion scale datasets.
Currently, when a new algorithm is submitted, only @harsha-simhadri can run it since he has the existing results files from all other algorithms on the standard Azure machine (in order...
[To keep track of my own tasks] The user has to decide if the results files are compared to public or private queries at the moment. We should rather use...
We are looking to test our submission on a 100M scale filtered dataset, and would be happy to integrate it into `datasets.py` if the embeddings and metadata were added to...
Team RuBignn's submission of the filter track. Our submission should be run by the custom setup, please refer to the README file for detailed processes. We have the script to...
when running `python install.py --neurips23track filter --algorithm faiss` and after waiting for 40 minutes, it finally output: ``` What's Next? View summary of image vulnerabilities and recommendations → docker scout...
This PR includes any workarounds/fixes related to testing the baseline PR/framework branch.
This is a draft PR to get ideas/feedback around possible changes to BaseANN for the second competition. Assumptions: * each object in a dataset could have a dense vector or...
The current workflow to run algorithm X on dataset Y is something like this: 1. `python install.py` builds docker container 2. `python create_dataset.py` sets up datasets 3. `python run.py --dataset...
Track 1 & Track 2 can run successfully. But I met a Track 3 docker evironment error because nvidia/cuda:11.0-devel-ubuntu18.04 is no longer available. ``` Install Status: {'faiss_t3': 'fail'} => ERROR...
Metadata
Owner
Metadata
Framework for evaluating ANNS algorithms on billion scale datasets.