Reproducing the plots

[ethen8181]

Hi, I was trying to reproduce the plots and was confused a bit by the steps:

So I first did:

python create_ann_benchmarks_data.py

This created a file called lastfm50-10000--1-3.npz. After that, I am not sure what do you mean by copy to the 'queries' folder in your ann-benchmarks.

When I tried to ignore that and moved on to the next instruction:

# dataset is the path to the .npz file
python ann_benchmarks/main.py --dataset lastfm50-10000--1-3.npz --algo 'hnsw(nmslib)' --algo faiss --algo annoy

I get ModuleNotFoundError: No module named 'ann_benchmarks'. Some guidance will be much appreciated. Thanks

[ethen8181]

@benfred ping ~

[benfred]

@ethen8181 I accidentally deleted my fork of ann-benchmarks that were needed to reproduce this - so I don't think the steps there work anymore =( ann-benchmarks has changed signficantly since I first wrote that post, and the code here won't work with the newer version.

I fixed up this code to work with the newer ann-benchmarks here: https://github.com/erikbern/ann-benchmarks/pull/91

Once it's merged I'll update the steps to generate - but roughly will be follow the install instructions in ann-benchmarks to get it set up, and then run

python run.py --dataset lastfm-64-als --algo 'hnsw(nmslib)' --algo faiss --algo annoy

to run the experiments

[ethen8181]

I see, thanks for the update. Will wait for the merge & updated steps.