Leon Schönbrunn

Yes, with normalization and relu you need higher learning rates to notice the changes (try enabling dropout, will help to prevent overfitting when using high learning rates). You should still...

I sometimes got this specific 20MiB CUDA OOM Error when I was still loading the nai.YAML file. If you are loading the .yaml on startup, back up the .yaml somewhere...

@aria1th Whenever you load a hypernetwork that also has a .optim file in the hypernetwork directory, the UI says that it not only loads the hypernetwork, but also the optimizer....