stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

Published 20 hours ago • verified publisher icon AUTOMATIC1111

Should unload VAE before training textural inversion?

Open MaikoTan opened this issue 2 years ago • 2 comments

I see recently the Unload VAE and CLIP from VRAM when training feature is added, but only effect in hypernetwork training. So I am confused whether or not I should unload the VAE before training the textural inversion. (I always get ungly images while training TI with VAE loaded, so I guess it is true). So I think the Unload VAE and CLIP function should also effect in TI training.

MaikoTan avatar Oct 13 '22 07:10 MaikoTan

Yes, I got the same image as you described the first few times I didn't uninstall, and after uninstalling I finally got a normal image.

Small-tailqwq avatar Oct 13 '22 15:10 Small-tailqwq

There are also possible VAE related bugs in img2img, we might need a checkbox if VAE should be used or not.

cmp-nct avatar Oct 13 '22 16:10 cmp-nct

https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/3866 Looks like it's possible to just set VAE to None before training.

mezotaken avatar Jan 13 '23 09:01 mezotaken