chatgpt-retrieval-plugin icon indicating copy to clipboard operation
chatgpt-retrieval-plugin copied to clipboard

Why not use vector search lib instead of service

Open salamer opened this issue 2 years ago • 1 comments

Hi, I found it's a very interesting repo, it recommends some vector search services, I wonder why not use some vector search libraries instead of services, personal scene retrieval candidate set is small, and all these libraries support serialization as Objects are stored on disk. These libs occupy less memory and are more suitable for personal scenarios. in general, library is more comvienient in most scenarios, and the service is more scalable when the scenarios became heavy.

Libraries I recommend:

  • faiss: A library for efficient similarity search and clustering of dense vectors.
  • hora: 🚀 efficient approximate nearest neighbor search algorithm collections library written in Rust 🦀 .
  • qdrant: Vector Search Engine and Database for the next generation of AI applications.

and for more library: awesome vector search

salamer avatar Mar 27 '23 08:03 salamer

Qdrant isn't a vector search library, its a service aswell.

These libraries aren't designed to offer the best CRUD functionalities, so using databases makes sense. In addition to this, filtering and other operations would need to be implemented.

filip-halt avatar Mar 28 '23 19:03 filip-halt