ann-benchmarks
ann-benchmarks copied to clipboard
How to run algorithm with --local and --parallelism >1?
Hi, Erik Here are several issues are seen when I run algorithm with --local and --parallelism > 1, could you please take a look?
- Milvus is failed to create index with pymilvus.exceptions.MilvusException: <MilvusException: (code=65535, message=CreateIndex failed: at most one distinct index is allowed per field)>. And seems that the data are inserted several times.
- Although log shows "Terminating 31 workers", the QPS for pgvector seems to be only for one process, not the QPS for all parallel processes, right? Thanks. J
Running command:
python run.py --dataset fashion-mnist-784-euclidean --local --parallelism 31 --algorithm pgvector --force python run.py --dataset fashion-mnist-784-euclidean --local --parallelism 31 --algorithm milvus-hnsw --force