stable-diffusion.cpp
stable-diffusion.cpp copied to clipboard
cannot force cpu
setting -- rng to std_default is still attempting to use the gpu. I wanted to test cpu only speeds but I can see in the console it is still using the gpu
--rng is only used to chose the random number generator algorithm. It's not used to chose which device to run inference on. Right now the only way to run the diffusion model on cpu is to use a CPU only build. Maybe a --diffusion-on-cpu flag could be a nice addition. But right now it doesn't exist.