taming-transformers icon indicating copy to clipboard operation
taming-transformers copied to clipboard

lr scheduler

Open MaxyLee opened this issue 4 years ago • 1 comments
trafficstars

Hi, there. I met with such a warning that "You are using LearningRateMonitor callback with models that have no learning rate schedulers. Please see documentation for configure_optimizers method." when training a transformer model on FFHQ and Celeba-HQ. Could you please tell me what kind of lr scheduler did you use and if possible, other hyperparameters like lr, batch size, etc during training. Thanks!

MaxyLee avatar Oct 02 '21 14:10 MaxyLee