pytorch-cosine-annealing-with-warmup icon indicating copy to clipboard operation
pytorch-cosine-annealing-with-warmup copied to clipboard

Published 20 hours ago • verified publisher icon katsura-jp

Warmup steps only apply on the first cycle

Open katsura-jp opened this issue 2 years ago • 0 comments

From #11.

Currently, warmup is applied in all cycles. Therefore, it is possible to apply warmup only in the first cycle by using an argument. Similar to here.

katsura-jp avatar Oct 28 '22 06:10 katsura-jp