Custom Model Setting Up Issue in Playground

[skj092]

1. Opik Version: commit 7db1b89f0155e3f9c65b35d52b4ba01fb0a38252 (HEAD -> main, tag: 1.8.37-2515)
2. Model serving using: ollama run gemma3:270m

This is how I setup Custom Model on opik playground:

but I get this error in opik playground output: 'Unexpected error calling LLM provider '

[Lothiraldan]

Hi @skj092, thank you for opening an issue. I have a few questions so we can help you:

• Are you using a docker-compose deployment of Opik?
• Are you running Ollama on your laptop? In docker?
• Do you see any error in the docker logs?

[skj092]

Thanks for the reply,

• yes, I am using docker compose using opik.sh file.
• ollama I am using without docker (ollama run modelname from terminal)
• I see connection issue in opik backend logs.

[yhavinga]

I got the same error, the cause was that host.docker.internal in my docker setup was not defined. When using 172.17.0.1 instead of host.docker.internal it worked (the ip address of the docker0 interface)

[YarivHashaiComet]

Thanks for sharing @yhavinga!

@skj092 can you share the full command you was using? did you use the --port-mapping as well? plz let us know if you still facing any issue that we would be able to support you

[YarivHashaiComet]

@skj092 - i'm closing this one - feel free to open it up in case you still facing any issue