ann-benchmarks icon indicating copy to clipboard operation
ann-benchmarks copied to clipboard

How to run algorithm with --local and --parallelism >1?

Open gerbility opened this issue 6 months ago • 0 comments

Hi, Erik Here are several issues are seen when I run algorithm with --local and --parallelism > 1, could you please take a look?

  1. Milvus is failed to create index with pymilvus.exceptions.MilvusException: <MilvusException: (code=65535, message=CreateIndex failed: at most one distinct index is allowed per field)>. And seems that the data are inserted several times.
  2. Although log shows "Terminating 31 workers", the QPS for pgvector seems to be only for one process, not the QPS for all parallel processes, right? Thanks. J

Running command:

python run.py --dataset fashion-mnist-784-euclidean --local --parallelism 31 --algorithm pgvector --force python run.py --dataset fashion-mnist-784-euclidean --local --parallelism 31 --algorithm milvus-hnsw --force

gerbility avatar May 10 '25 13:05 gerbility