fast-stable-diffusion icon indicating copy to clipboard operation
fast-stable-diffusion copied to clipboard

Published 20 hours ago • verified publisher icon TheLastBen

DreamBooth and DeepSpeed

Open Dullson opened this issue 3 years ago • 4 comments

There was a reddit thread claiming to run dreambooth under 8GB VRAM using DeepSpeed, they also shared their code. I don't see anyone in the replies reporting success and I also failed to make it work. Maybe you or someone in the community can figure it out and we can lower VRAM requirements further. Here is my test notebook for paperspaces if you want to check it out.

Dullson avatar Oct 06 '22 23:10 Dullson

I saw that, it requires at least 25GB of RAM which is inconvenient for Google Colab since it offers 16GB GPUs and 12GB of RAM

TheLastBen avatar Oct 07 '22 07:10 TheLastBen

Yes, it's not suitable for colab but paperspace offers 8GB VRAM and 30GB RAM on their lowest free tier machines. Almost like a perfect candidate for this. Their running times are not as restricted. This might be a good way to relieve some pressure from colab.

Dullson avatar Oct 07 '22 09:10 Dullson

datacrunch offers 80GB gpus, but it's jupyterlabs, been tying to convert colab to jupyter but wrestling with dependencies

grctest avatar Oct 13 '22 18:10 grctest

I have tried this out myself, 8 GB GPU and 48 GB RAM, and most others that have tried it have had no success. It will always OOM. Even on a 16 GB card with 64 GB RAM people are running into OOM.

78Alpha avatar Nov 07 '22 00:11 78Alpha