bmaltais

Link to python module for reference: https://pypi.org/project/dadaptation/

Quick comparison results from DAdaptAdam with TE:0.5 and UNet:1.0: DAdaptAdam-1-1: loss: 0.125, dlr: 4.02e-05 DAdaptAdam-0.5-1: Loss: 0.124, dlr: 4.53e-05 DAdaptAdam-1-1:  DAdaptAdam-0.5-1:  I think the winner is clear. TE...

@AI-Casanova I did it with lr_scheduler = optim.lr_scheduler.LambdaLR(optimizer=optimizer, lr_lambda=[lambda epoch: 0.5, lambda epoch: 1], last_epoch=-1, verbose=False)

Here is an interesting finding. For DAdaptSGD having a TE and UNet lambda both at 1 is better than 0.5,1... DAdaptSGD-1-1:  DAdaptSGD-0.5-1:  I wonder if having a weaker...

And here are teh results of DAdaptSGD-1-0.5:  I think DAdaptSGD-1-1 is still the best config for that method. Well... I am looking at the results and I am not...

Good question... I don't really know. But DAdaptAdam-0.5-1 appear to produce the most likeness of all the method... so I might stick with that for now...

Published 1st model made with this new technique: https://civitai.com/models/8337/kim-wilde-1980s-pop-star

For some of those recommendations it would require modifications of the code maintained by kohya in his repo. You should ask him to implement them and once he does I...

If anyone know how to implement the interrupt function in python please let me know... I know enough python just to be dangerous ;-) but I would gladly take a...

One day I might research the subject and see if it would be implemented... But since the GUI is just a layer on top of the various CLI I am...