rabner
rabner
Similar issue on AIO CPU, but when invoking image generation from Nextcloud: `localai | 7:26PM ERR Server error error="rpc error: code = Unavailable desc = error reading from server: EOF"...
Is there any update on the issue? It seems I have the same error. PVE 6.3-3 icinga2 2.11.2-1ubuntu3 arm64
The same issue, 'deepseek-coder-v2-lite-instruct' from models repository is not usable. BTW Does anyone have a guide how to 'translate' Ollama template to use in LocalAI?
Workaround by reverting to 2.23.
It seems I have the same issue since first started setting up LocalAI AIO docker on CPU few weeks ago. So far I've managed to narrow down the issue to...