[BUG]: LanceDBError with nomic-embed-text

[ZiHAO-LI-cmd]

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I deployed nomic-embed-text:last embedding model on server but met an error when using it.

If I switch to AnythingLLM Embedder, it works well. The nomic-embed-text model works well in server because I tested it and it can return embedding vectors. So, I think it maybe the incompatibility problem with LanceDB.

Are there known steps to reproduce?

Same error from others: https://github.com/ollama/ollama/issues/2778

[timothycarambat]

On latest ollama:

• ollama serve is running

• ollama pull nomic-embed-text Set up embedder connection

• Create new workspace

• Upload fresh document and move into workspace

• Document is embedded successfully

• Send Chat - complete response (openAi as LLM)

Confirm DB has vectors

[timothycarambat]

Closing this issue. This error results from swapping embedder providers or models after you already have cached documents or active embeddings.

When you change embedders - the dimensions between previously embedded content and new content or queries will not work. That is just how it works. We have now set a warning telling you this to prevent running into this issue #1131