stable-dreamfusion icon indicating copy to clipboard operation
stable-dreamfusion copied to clipboard

Blobs as outputs

Open VladStojDev opened this issue 2 years ago • 3 comments

Hi all,

I keep getting just basic blobs/clouds of smoke as the output when I try and run some custom prompts. This is the prompt/config call I am using:

python3 main.py --text "a green monster truck" --workspace trial -O --guidance stable-diffusion --seed 12387651

I also tried without any seed parameter. Any ideas?

Thanks in advance!

VladStojDev avatar Oct 26 '22 08:10 VladStojDev

I think it is likely just the number of training steps.

The default is only set to 10000, which ends up being a total of like 100 epochs.

Try something like --iters 100,000 (Will take much longer, but should be better)

Other option is to look into finding better pre-training weights. Likely you have no checkpoints downloaded from the model and so it is training from scratch, this will also impede performance.

mfogelson avatar Oct 26 '22 22:10 mfogelson

Thanks, I will try - Though even with my dual RTX A6000's, with 100 epochs it takes like 5 minutes... Will update you once I run some more experiments! Thanks for you suggestion!

VladStojDev avatar Nov 01 '22 08:11 VladStojDev

I encountered the same problem, were you able to get better results with more epochs?

anna-charlotte avatar Nov 10 '22 10:11 anna-charlotte