haystack icon indicating copy to clipboard operation
haystack copied to clipboard

Published 20 hours ago • verified publisher icon deepset-ai

FAISS in OpenSearch: Support IVF

Open tstadel opened this issue 2 years ago • 0 comments

As a user I want to use FAISS's IVF index with OpenSearchDocumentStore.

According to https://opensearch.org/docs/latest/search-plugins/knn/knn-index/ FAISS plug-in supports IVF. There are two params nlist and nprobes. As we're not sure whether this is useful, we only support the default values for now and omit configuration of these params. They could be configured via custom_mapping anyway.

  • [ ] add ivf option to index_type constructor param
  • [ ] set mapping: use default values
  • [ ] support product quantization

tstadel avatar Jul 28 '22 16:07 tstadel