Ranger-Deep-Learning-Optimizer icon indicating copy to clipboard operation
Ranger-Deep-Learning-Optimizer copied to clipboard

Published 20 hours ago • verified publisher icon lessw2020

Stochastic Weight Averaging support

Open Archelunch opened this issue 4 years ago • 1 comments

Does Ranger support Stochastic Weight Averaging?

Archelunch avatar Sep 21 '20 12:09 Archelunch

I was going to ask about it, I wonder if it can increase accuracy further on Nlp tasks. https://pytorch.org/blog/pytorch-1.6-now-includes-stochastic-weight-averaging/

LifeIsStrange avatar Sep 24 '20 21:09 LifeIsStrange