infiniflow
Not able to add bge-m3 as the embedding model.
Is there an existing issue for the same bug?
- [x] I have checked the existing issues.
RAGFlow workspace code commit ID
0
RAGFlow image version
v0.16.0
Other environment information
Actual behavior
Even if bge-m3 is visible in the ollama model list. I am not able to add it as the embedding model. I was able to add llama3.2 as chat model. I am using the full version (v0.16.0) of RAGflow.
Expected behavior
No response
Steps to reproduce
Create a ollama environment in docker and pull llama3.2 and bge-m3 models in it.
Compose the full version of RAGflow (v0.16.0) (by editing the Docker/.env file) in docker.
Login into RAGflow and add a ollama model with llama3.2 as the chat model. It worked for me.
Now when I try to add bge-m3 as the embeddiong model, it says,"Not able to find bge-m3. Try pulling it first."
Although in this video, the person was able to add it. (https://www.youtube.com/watch?v=kAuVcCwqgwQ)
I dont know what wrong I am doing.
Additional information
Could you paste screen shot of error message here?
Hi, I just pasted a screenshot.
What about pulling it again? The error message is from Ollama.
ollama pull bge-m3
What about pulling it again? The error message is from Ollama.
ollama pull bge-m3
I have tried pulling again. I can see the model's name in the ollama list of models. I have 2 models (llama3.2 and bge-m3) in the list. RAGflow is able to find llama3.2 but not bge-m3.
The error logged on ragflow server:
2025-02-22 00:49:37 2025-02-22 03:19:37,666 INFO 18 HTTP Request: POST http://host.docker.internal:11434/api/embeddings "**HTTP/1.1 404 Not Found**" 2025-02-22 00:49:37 2025-02-22 03:19:37,667 ERROR 18 2025-02-22 00:49:37 Fail to access embedding model(bge-m3).model "bge-m3" not found, try pulling it first
The following quick fix worked. It seems to be an issue with DNS resolution
- log in into ragflow server and see host list ls /etc/hosts
- use the ip address mapped to host.docker.internal instead when providing base url on ragflow management screen
The error logged on ragflow server:
2025-02-22 00:49:37 2025-02-22 03:19:37,666 INFO 18 HTTP Request: POST http://host.docker.internal:11434/api/embeddings "**HTTP/1.1 404 Not Found**" 2025-02-22 00:49:37 2025-02-22 03:19:37,667 ERROR 18 2025-02-22 00:49:37 Fail to access embedding model(bge-m3).model "bge-m3" not found, try pulling it firstThe following quick fix worked. It seems to be an issue with DNS resolution
- log in into ragflow server and see host list ls /etc/hosts
- use the ip address mapped to host.docker.internal instead when providing base url on ragflow management screen
Hello, I am already using the host.docker.internal as you can see in the screenshot above. Also, I did not get your 1st point to see host list. Can you you ellaborate on how to do that?
The error logged on ragflow server:
2025-02-22 00:49:37 2025-02-22 03:19:37,666 INFO 18 HTTP Request: POST http://host.docker.internal:11434/api/embeddings "**HTTP/1.1 404 Not Found**" 2025-02-22 00:49:37 2025-02-22 03:19:37,667 ERROR 18 2025-02-22 00:49:37 Fail to access embedding model(bge-m3).model "bge-m3" not found, try pulling it firstThe following quick fix worked. It seems to be an issue with DNS resolution
1. log in into ragflow server and see host list ls /etc/hosts 2. use the ip address mapped to host.docker.internal instead when providing base url on ragflow management screen
It should be:
sudo docker exec -it ragflow-server bash
cat /etc/hosts
I was able to solve this by using the IP address mapped onto host.docker.internal
2025-06-13 16:20:08,437 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:08] "GET /v1/llm/factories HTTP/1.1" 200 - 2025-06-13 16:20:12,363 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:12] "GET /v1/user/tenant_info HTTP/1.1" 200 - 2025-06-13 16:20:12,419 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:12] "GET /v1/llm/list HTTP/1.1" 200 - 2025-06-13 16:20:23,304 ERROR 20 Fail to access embedding model(bge-m3:latest).[Errno 111] Connection refused NoneType: None 2025-06-13 16:20:23,306 INFO 20 172.20.0.6 - - [13/Jun/2025 16:20:23] "POST /v1/llm/add_llm HTTP/1.1" 200 - 2025-06-13 16:20:31,856 WARNING 36 RedisDB.queue_info rag_flow_svr_queue got exception: no such key
