documentation icon indicating copy to clipboard operation
documentation copied to clipboard

v1.11: New embedder option: `binaryQuantized`

Open guimachiavelli opened this issue 5 months ago • 0 comments

This release introduces a new embedder setting, binaryQuantized. This setting converts embeddings of floating point numbers into boolean values. This reduces relevancy of semantic search results, but greatly reduces database size.

Activating binaryQuantized is irreversible. Once a user sets it to true, all relevant information is irrevocably and the only way to get it back is to re-vectorize the whole index in a new embedder.

Task

  • [x] Update reference/api/settings#body-18

References

  • PRD: https://www.notion.so/meilisearch/Handle-a-larger-vector-dataset-50f2d10618bf480bba0d994e6571be0c
  • SME: @irevoire
  • Engine issue: https://github.com/meilisearch/meilisearch/issues/4873

guimachiavelli avatar Sep 24 '24 15:09 guimachiavelli