local-rag icon indicating copy to clipboard operation
local-rag copied to clipboard

Docs for locally running ollama integration doesn't work

Open realyashnag opened this issue 1 year ago • 1 comments

Describe the Bug Setup doc where it suggests using extra_hosts: 'host.docker.internal:host-gateway' is not working for Docker version 27.0.3, build 7d4bcd8. The container fails to connect to ollama running on the host.

How To Reproduce Following the setup doc with docker version 27.

Expected Behavior Connection to the ollama service should be seamless.

Proposed Solution Directly using network_mode: "host" works out of the box just fine.

realyashnag avatar Jul 11 '24 20:07 realyashnag

Another alternative is to start ollama bind to external interfaces OLLAMA_HOST=0.0.0.0:11434 ollama serve and configure the ollama_endpoint with the public interface

electrocucaracha avatar Jan 14 '25 20:01 electrocucaracha