Alpaca icon indicating copy to clipboard operation
Alpaca copied to clipboard
verified publisher icon Jeffser

Message generation failed, Request timed out.

Open Stroemie opened this issue 9 months ago • 3 comments

A clear and concise description of what the bug is.

Image

Image

Happens after closing Alpaca app in Gnome and opening it again.

Still had enough free ram. Running ollama locally. No GPU, CPU only.

Image

Stroemie avatar Mar 15 '25 09:03 Stroemie

Thanks for the report. I have collected some more information:

  • the bug is not reproducible if "Run Alpaca in background" is deactivated.
  • when it is activates, the bug does still not occur to me, but at least something different happens: Alpaca's integrated Ollama instance exits when opening Alpaca again (after it ran in the background), losing the model from RAM and kind of defeating the purpose of the setting.
  • the model stays in RAM after closing Alpaca, but it is lost after opening it again

In conclusion, I was unable to reproduce this specific bug.

mags0ft avatar Mar 15 '25 16:03 mags0ft

I'm sure you have try this but just to confirm, does your Ollama instance work outside of Alpaca?

Jeffser avatar Mar 15 '25 16:03 Jeffser

Yes, Ollama works outside Alpaca. Memory is still occupied after closing Alpaca. I will try to reproduce it without having Alpaca running in background activated.

Stroemie avatar Mar 17 '25 08:03 Stroemie