Stroemie

Message generation failed, Request timed out.

3

A clear and concise description of what the bug is.   Happens after closing Alpaca app in Gnome and opening it again. Still had enough free ram. Running ollama...

Is it possible to set the number of CPU cores/threads for inference in Alpaca? Situation: Running Alpaca and Ollama on CPU (12 cores, multi-treading disabled) and RAM (2 channels DDR5...