chatd icon indicating copy to clipboard operation
chatd copied to clipboard

Published 20 hours ago • verified publisher icon BruceMacD

Using a remote server for ollama

Open qcts33 opened this issue 1 year ago • 1 comments

I'm using a laptop for daliy work and I have a GPU server. So, it would be nice if I can use chatd as a frontend and running the LLMs in my server with ollama.

By the way, I'm currently using a local reverse-proxy to make chatd connect to my server. It works fine, but a little complicated.

caddy reverse-proxy --from :11434 --to server:11434

qcts33 avatar Dec 27 '23 08:12 qcts33

Related to this, please make it so that for Linux builds, you don't have to copy the Ollama binary to the source folder. It should just be able to interact with the API running either locally or remotely, as all other Ollama clients do.

ThatOneCalculator avatar Dec 28 '23 02:12 ThatOneCalculator