FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

Sparse vector storage in BGE-M3 can be implemented using FAISS?

Open hahaha1121871443 opened this issue 1 year ago • 1 comments

Recently, I completed a RAG system project, and I want to use the three retrieval methods in bge-m3. However, currently, when using BGEM3FlagModel () to load the model, errors will be reported when using faiss to embed the vector, while no errors will be reported when using sentencetransformer () to load the model. However, the return_dense and return_sparse properties are not available. Whether the bge-m3 sparse vector cannot be embedded using faiss?

hahaha1121871443 avatar Sep 20 '24 09:09 hahaha1121871443

@hahaha1121871443 , faiss cannot support the sparse vector.

staoxiao avatar Sep 30 '24 09:09 staoxiao