fast-stable-diffusion icon indicating copy to clipboard operation
fast-stable-diffusion copied to clipboard

more options for UNet_Learning_Rate

Open brunakrc opened this issue 2 years ago • 6 comments

could you put more option for training speed? example 1e-6 ?

brunakrc avatar Dec 31 '22 19:12 brunakrc

You can just modify the notebook yourself right?

MaxTran96 avatar Jan 01 '23 22:01 MaxTran96

1e-6 is much much lower and slower than 1e-5

TheLastBen avatar Jan 01 '23 23:01 TheLastBen

I remember several articles suggested to use 1e-6 and 2e-6 for person and items training. Using the 2e-6 seems good though.

Do we have experience to obtain better result using 1e-5?

longlivebigcat avatar Jan 02 '23 04:01 longlivebigcat

with 2e-5, you can get results under 700 steps

TheLastBen avatar Jan 02 '23 08:01 TheLastBen

Can someone please explain what do the letters and numbers means in 1e-6, 2e-6, 1e-5, etc? or point me a few links in the right direction? I searched on google but all I'm finding are general tutorials and not any detailed information.

impallari avatar Mar 10 '23 08:03 impallari

2e-6 = 0.000002 2e-5 = 0.00002

2e-6 is a low (normal) learning rate, 2e-5 is a high learning rate.

TheLastBen avatar Mar 10 '23 09:03 TheLastBen