big-ann-benchmarks icon indicating copy to clipboard operation
big-ann-benchmarks copied to clipboard

T3: NVIDIA Single GPU (cuanns_ivfpq)

Open anaruse opened this issue 2 years ago • 5 comments

This is a submission of the NVIDIA team for single GPU in T3 track. After the built index upload is complete, we will update instructions on how to download the index files.

anaruse avatar Oct 23 '21 03:10 anaruse

@anaruse. OK, we synced over the new config and re-ran the evaluation. Please verify the following:

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/cuanns_ivfpq/algos.yaml

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/eval_2021/cuanns_ivfpq/EvalPublic.ipynb

sourcesync avatar Nov 27 '21 18:11 sourcesync

@anaruse OK, we synced your new algos yaml and reran. It looks like a slight improvement to text2image-1B. Please verify the config and results notebook below:

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/cuanns_ivfpq/algos.yaml

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/eval_2021/cuanns_ivfpq/EvalPublic.ipynb

sourcesync avatar Nov 29 '21 01:11 sourcesync

Thank you for re-running it. I've checked the config and the results. It looks good to me!

anaruse avatar Nov 29 '21 10:11 anaruse

@anaruse Great.

sourcesync avatar Nov 29 '21 17:11 sourcesync

@anaruse OK, we re-evaluated your submission. The "anomaly" count was reduced successfully from 7 to 5. Thanks.

Can you verify the following?

new config we synced:

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/cuanns_ivfpq/algos.yaml

eval notebook - https://github.com/harsha-simhadri/big-ann-benchmarks/blob/gw/T3/t3/eval_2021/cuanns_ivfpq/EvalPublic.ipynb

Thanks!

sourcesync avatar Dec 01 '21 03:12 sourcesync