big-ann-benchmarks icon indicating copy to clipboard operation
big-ann-benchmarks copied to clipboard

Implement Track-3 base-line index database

Open Zachacy opened this issue 2 years ago • 1 comments

I try to built index database of track-3 follow : python track3_baseline_faiss/gpu_baseline_faiss.py --dataset bigann-1B \ --indexkey IVF1048576,SQ8 \ --train_on_gpu \ --build --quantizer_on_gpu_add --add_splits 30 \ --search \ --searchparams nprobe={1,4,16,64,256} \ --parallel_mode 3 --quantizer_on_gpu_search but failed caused by DRAM 128GB less than base-line 768GB. Someone could provide Track-3 Base-line link , thanks

Zachacy avatar Aug 19 '22 00:08 Zachacy

I recommend you instead follow the directions here:

https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/t3/README.md

Please DM me if you need additional help.

George

On Thu, Aug 18, 2022 at 5:52 PM Zachacy @.***> wrote:

I try to built index database of track-3 follow : python track3_baseline_faiss/gpu_baseline_faiss.py --dataset bigann-1B
--indexkey IVF1048576,SQ8 \ --train_on_gpu \ --build --quantizer_on_gpu_add --add_splits 30 \ --search \ --searchparams nprobe={1,4,16,64,256}
--parallel_mode 3 --quantizer_on_gpu_search but failed caused by DRAM 128GB less than base-line 768GB. Someone could provide Track-3 Base-line link , thanks

— Reply to this email directly, view it on GitHub https://github.com/harsha-simhadri/big-ann-benchmarks/issues/99, or unsubscribe https://github.com/notifications/unsubscribe-auth/AADL6CNLS424WR52NRMCT3DVZ3LE3ANCNFSM567AONNA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

sourcesync avatar Aug 19 '22 00:08 sourcesync