local-rag
local-rag copied to clipboard
Docs for locally running ollama integration doesn't work
Describe the Bug
Setup doc where it suggests using extra_hosts: 'host.docker.internal:host-gateway' is not working for Docker version 27.0.3, build 7d4bcd8. The container fails to connect to ollama running on the host.
How To Reproduce Following the setup doc with docker version 27.
Expected Behavior Connection to the ollama service should be seamless.
Proposed Solution
Directly using network_mode: "host" works out of the box just fine.
Another alternative is to start ollama bind to external interfaces OLLAMA_HOST=0.0.0.0:11434 ollama serve and configure the ollama_endpoint with the public interface