Michael Yang
Michael Yang
Can you elaborate? It's unclear what issue your experience or what you mean by "the model path you guys specified doesn't exist".
I'm not able to reproduce this using `llama2` and `mistral` with setting `seed` and `temperature` through both the API and the Modelfile. What version of ollama (`ollama -v`) are you...
@Fei-Wang what kind of model is `q4_0.bin`? The template may be incorrect. It should probably be something like this: ``` [INST] {{ .System }} {{ .Prompt }} [/INST] ``` ``...
Can you describe in detail the steps you took? In particular, 1) where the Ollama container is running (remote, local) 2) where proxy settings are configured and 3) where the...
By setting `HTTP_PROXY` and running `ollama` subcommands inside the docker container, it applies proxy the CLI request through your proxy. You should remove `HTTP_PROXY` but keep `HTTPS_PROXY`. This will still...
Going to close this since there hasn't been an update in a while. If it continues to be a problem, please open a new issue
`Connection refused` indicates the service is not exposed/listening on this address/port. Is ollama configured to listen on 0.0.0.0? It only listens on localhost by default so if you want to...
> ConnectionError: HTTPConnectionPool(host=‘0.0.0.0’, port=11434): @yliu2702 you're making a request to 0.0.0.0 port 11434, did you configure ollama to bind to 0.0.0.0:11434? If it's not configured to bind to 0.0.0.0, this...
Home directories (`/home/*`) sometimes have permissions 750 which prevent others from reading or accessing the directory. Ollama runs as user/group ollama which won't have access to your home directory. There's...
> Environment="PATH=/home/……:/snap/bin OLLAMA_DEBUG=1" `OLLAMA_DEBUG` needs to be on its own `Environment` line ``` Environment="PATH=/home/……:/snap/bin" Environment="OLLAMA_DEBUG=1" ```