Harsha Vardhan Simhadri

@nk2014yj Is the PR ready for review and running?

@nk2014yj I see the following error when trying to run your algorithm on the bigann-1B dataset. IT looks like the algo needs more disk space. I have 100GB+ left on...

> > @nk2014yj I see the following error when trying to run your algorithm on the bigann-1B dataset. IT looks like the algo needs more disk space. I have 100GB+...

@nk2014yj Can we just avoid the tar download and unzip? You can download multiple files into the index location. See diskann-t2 example. See: https://github.com/harsha-simhadri/big-ann-benchmarks/blob/c13dbd9ab4c14b76e726df55635e7fbd11626d5c/benchmark/algorithms/diskann-t2.py#L117

> > @nk2014yj Can we just avoid the tar download and unzip? You can download multiple files into the index location. See diskann-t2 example. See: > > https://github.com/harsha-simhadri/big-ann-benchmarks/blob/c13dbd9ab4c14b76e726df55635e7fbd11626d5c/benchmark/algorithms/diskann-t2.py#L117 > >...

> > > > @nk2014yj Can we just avoid the tar download and unzip? You can download multiple files into the index location. See diskann-t2 example. See: > > >...

I see the following results puck-t1,"Puck(10,20,20000,2000)",text2image-1B,10,8421.55159395627,0.0,1000000.0,58235268.0,6915.028347245721,0,0,0.18284499999999998 puck-t1,"Puck(10,20,19000,700)",text2image-1B,10,9992.153845145944,0.0,1000000.0,58235268.0,5828.0996172101495,0,0,0.169676 puck-t1,"Puck(10,20,10000,1000)",text2image-1B,10,11486.521144580363,0.0,1000000.0,58235268.0,5069.878622691336,0,0,0.156922 puck-t1,"Puck(10,10,8000,500)",text2image-1B,10,13356.761913581453,0.0,1000000.0,58235268.0,4359.98398240408,0,0,0.139568 puck-t1,"Puck(10,20,20000,1000)",text2image-1B,10,9476.185872600267,0.0,1000000.0,58235268.0,6145.433276945658,0,0,0.175994 puck-t1,"Puck(10,30,12000,800)",text2image-1B,10,11071.05747014423,0.0,1000000.0,58235268.0,5260.136003904362,0,0,0.160653 puck-t1,"Puck(10,20,9000,700)",text2image-1B,10,12278.106292357348,0.0,1000000.0,58235268.0,4743.017091833553,0,0,0.149852 puck-t1,"Puck(10,10,6000,500)",text2image-1B,10,13968.31473840465,0.0,1000000.0,58235268.0,4169.097639236841,0,0,0.130515 puck-t1,"Puck(10,30,11000,1000)",text2image-1B,10,11007.853983343128,0.0,1000000.0,58235268.0,5290.3379794209195,0,0,0.16063 puck-t1,"Puck(10,30,14000,600)",text2image-1B,10,10895.878411849368,0.0,1000000.0,58235268.0,5344.7061171927735,0,0,0.160987 puck-t1,"Puck(10,90,100000,900)",msturing-1B,10,4001.8958871850186,0.0,1000000.0,58110520.0,14520.747575188827,0,0,0.8428610000000001 puck-t1,"Puck(10,30,20000,200)",msturing-1B,10,11864.653408637023,0.0,1000000.0,58110520.0,4897.784873993683,0,0,0.773385 puck-t1,"Puck(10,50,20000,300)",msturing-1B,10,11351.811248596823,0.0,1000000.0,58110520.0,5119.052698060227,0,0,0.7820280000000001 puck-t1,"Puck(10,60,23000,200)",msturing-1B,10,10793.241367891951,0.0,1000000.0,58110520.0,5383.972990066623,0,0,0.787577 puck-t1,"Puck(10,70,24000,300)",msturing-1B,10,10335.074102827077,0.0,1000000.0,58110520.0,5622.651509010887,0,0,0.79199 puck-t1,"Puck(10,20,22000,300)",msturing-1B,10,11461.173484450277,0.0,1000000.0,58110520.0,5070.206822961044,0,0,0.767586 puck-t1,"Puck(10,70,25000,300)",msturing-1B,10,10139.28810483003,0.0,1000000.0,58110520.0,5731.22288263197,0,0,0.793812 puck-t1,"Puck(10,40,19000,200)",msturing-1B,10,11683.661252533644,0.0,1000000.0,58110520.0,4973.656694077683,0,0,0.7760849999999999 puck-t1,"Puck(10,80,19000,600)",msturing-1B,10,10814.728634059795,0.0,1000000.0,58110520.0,5373.27583208952,0,0,0.7826660000000001 puck-t1,"Puck(10,60,19000,200)",msturing-1B,10,11713.697869548969,0.0,1000000.0,58110520.0,4960.903093724537,0,0,0.779256 puck-t1,"Puck(10,20,2000,200)",random-xs,10,177049.55677501054,0.0,1000000.0,2492.0,0.014075155258178712,0,0,0.9885999999999999

Martin, I defer to you on whether these are mergeable. To add to your points on where the functionality of the code is different, for the next iteration, I want...

@qiaoyuKs I see the following error when I checkout this PR, install Docker.kota (with success) and try to run msturing-1B. Can you see if you are able to actually run...

@qiaoyuKs I ran your code on Azure L8sv2 VM on the bigann, msturing and msspacev datasets and see the following results on the public query set. Are they as expected?...