knowhere icon indicating copy to clipboard operation
knowhere copied to clipboard

Support Faiss parallel_mode parameter

Open weiwang19 opened this issue 2 years ago • 3 comments

When evaluate Faiss performance we see that if the parallel mode is changed ( parallel_mode=2) we can get better performance on single vector queries, one example:

  parallel mode             Index                    num_threads           Leaves searched          single vector query latency 
       0 (default)   |   IVF8192,PQ128  |          56                  |       16                        |        27.6
             2             |   IVF8192,PQ128  |          56                  |       16                        |        11.3 

Not much difference is observed with 1000 batch vectors. Can Milvus expose the parallel_mode parameter to be configurable?

weiwang19 avatar Jul 21 '22 06:07 weiwang19

/assign

cydrain avatar Jul 26 '22 06:07 cydrain

Hi @weiwang19, this is a good suggestion, we will evaluate and see if this can be done in the next release.

cydrain avatar Jul 26 '22 06:07 cydrain

Hi is there plan to have the change in recent release?

weiwang19 avatar May 01 '23 23:05 weiwang19