langflow icon indicating copy to clipboard operation
langflow copied to clipboard

OllamaEmbeddings Hardcode the model cannot change from llama2

Open mrabbah opened this issue 10 months ago • 2 comments

Describe the bug I used the OllamaEmbeddings in my Flow, and I changed the model to "mxbai-embed-large" when I compile the Flow I got the following error:

ValueError: Error building node Qdrant(ID:Qdrant-hOQcv): Error raised by inference API HTTP code: 404, {"error":"model 'llama2' not found, try pulling it first"}

Looking at the source code of the OllamaEmbeddings node, I think it is hardcoded to use llama2

Browser and Version

To Reproduce Steps to reproduce the behavior:

  1. Run ollama on your local machine
  2. pull model mxbai-embed-large, (and as option mistral)
  3. in Langflow ui, create new project,
  4. import the following attached First Example RAG.json
  5. Change the host and port of your ollama in OllamaEmbeddings node
  6. Try to compile

Screenshots image

Additional context I run langflow throw Docker with the latest image version I pulled 04/13/2024

mrabbah avatar Apr 13 '24 13:04 mrabbah

Hey, this is the revised draft for the issue. You can paste it into a custom component and test it yourself. (Your version of langflow must be v1 or higher.)

https://github.com/langflow-ai/langflow/pull/1703

YamonBot avatar Apr 15 '24 11:04 YamonBot

Hello, Sorry for the delay. Did you try using the new version? Does the error still persist?

anovazzi1 avatar Jul 01 '24 16:07 anovazzi1

Hi @mrabbah

We hope you're doing well. Just a friendly reminder that if we do not hear back from you within the next 3 days, we will close this issue. If you need more time or further assistance, please let us know.


Thank you for your understanding!

carlosrcoelho avatar Jul 17 '24 14:07 carlosrcoelho

Thank you for your contribution! This issue will be closed. If you have any questions or encounter another problem, please open a new issue and we will be ready to assist you.

carlosrcoelho avatar Jul 22 '24 00:07 carlosrcoelho