bug: insufficient handling of insufficient memory

[jlfranklin]

Jan version

0.5.5

Describe the Bug

When there is insufficient memory to run the model, lot of errors are thrown into the logs, and the returned text is complete gibberish.

Jan should stop the model and say something like, "sorry, my brain is full."

Steps to Reproduce

1. Clean install of Jan on an 8GB Macbook Air M1
2. Load Qwen Chat 7B
3. Ask it anything.

Screenshots / Logs

app.log

What is your OS?

• [X] MacOS
• [ ] Windows
• [ ] Linux