codeqai
codeqai copied to clipboard
Assertion error in faiss
Very cool project, trying to get it to work I face some issue -
Using local embeddings (INSTRUCTOR_Transformer) and llamacpp model, any search/chat ends up in the following assertion:
load INSTRUCTOR_Transformer
max_seq_length 512
🔎 Enter a search pattern: preprocessing
⠹ 🤖 Processing...Traceback (most recent call last):
File "/Users/dinari/.local/bin/codeqai", line 10, in <module>
sys.exit(main())
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/codeqai/__main__.py", line 5, in main
app.run()
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/codeqai/app.py", line 177, in run
similarity_result = vector_store.similarity_search(search_pattern)
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/codeqai/vector_store.py", line 131, in similarity_search
return self.db.similarity_search(query, k=4)
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/langchain_community/vectorstores/faiss.py", line 544, in similarity_search
docs_and_scores = self.similarity_search_with_score(
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/langchain_community/vectorstores/faiss.py", line 417, in similarity_search_with_score
docs = self.similarity_search_with_score_by_vector(
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/langchain_community/vectorstores/faiss.py", line 302, in similarity_search_with_score_by_vector
scores, indices = self.index.search(vector, k if filter is None else fetch_k)
File "/Users/dinari/Library/Application Support/pipx/venvs/codeqai/lib/python3.10/site-packages/faiss/class_wrappers.py", line 329, in replacement_search
assert d == self.d
AssertionError
Using apple silicon arm64 arch.