Saminator

Results 3 comments of Saminator

Completely I agree that we should be able to use as much swap memory as we please. same here. using a 8GB model. I haven't tried your solution of changing...

right now I am trying to generate stable-diffusion on a 8gb m2 pro. only god can help me now.

> So for LLama and Mistral 32GB is plenty and probably 24 is also fine. I measured the peak memory use at around 16 GB so a 16GB machine would...