pytorch-cosine-annealing-with-warmup icon indicating copy to clipboard operation
pytorch-cosine-annealing-with-warmup copied to clipboard

Published 20 hours ago • verified publisher icon katsura-jp

Allow `max_lr` to be set per group

Open katsura-jp opened this issue 2 years ago • 0 comments

From #11.

Issue: if you have an optimizer with multiple groups with different learning rates, all of their learning rate values will get overridden by the max_lr.

katsura-jp avatar Oct 28 '22 06:10 katsura-jp