Jeremy Ho
Jeremy Ho
Would be good to consider allowing `mini`, `mega` and `mega_full` to be parsed as an environment variable. That way you can optionally pass that into the container through higher layers...
Looks like this problem is still occurring on the latest `16.16.0-alpine` tag.
Still need to do more tests, but looks like if `OLLAMA_KV_CACHE_TYPE` is not set to the default f16, it overflows and eats a bunch of system memory. Both tests ran...
+1 For having the container image artifacts pushed to ghcr.io would be ideal, similar to what already exists on the hub.docker.io side. If we do swap over to ghcr.io, we...