fastembed icon indicating copy to clipboard operation
fastembed copied to clipboard

[Bug]: Faiss Search Error with TextEmbedding

Open thlurte opened this issue 1 year ago • 1 comments

What happened?

I'm encountering a ValueError when attempting to perform similarity search with Faiss using embeddings generated by FastEmbed's TextEmbedding.embed method.

What Python version are you on? e.g. python --version

Python - 3.10.12 fastembed - 0.3.4 faiss - 1.8.0

Version

0.2.7 (Latest)

What os are you seeing the problem on?

Linux

Relevant stack traces and/or logs

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-40-6bb0fc687deb> in <cell line: 2>()
      1 import numpy
----> 2 index.search(a,1)

/usr/local/lib/python3.10/dist-packages/faiss/class_wrappers.py in replacement_search(self, x, k, params, D, I)
    325         """
    326 
--> 327         n, d = x.shape
    328         x = np.ascontiguousarray(x, dtype='float32')
    329         assert d == self.d

ValueError: not enough values to unpack (expected 2, got 1)

thlurte avatar Jul 22 '24 05:07 thlurte

usually we recommend to use proper vector database

generall avatar Jul 23 '24 20:07 generall