AdamW-pytorch icon indicating copy to clipboard operation
AdamW-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon egg-west
→

Metadata

Implementation and experiments for AdamW on Pytorch

Results 1 AdamW-pytorch issues
Sort by recently updated
recently updated
newest added

weight decay multiplied by learning rate

8 comment

If you look carefully at the formula in the article, the weight decay (w) is not multiplied by the learning rate (alpha), but rather by the schedule coefficient (eta). In...

kgoba avatar kgoba

← Metadata

91
Stars
19
Forks
Watchers

Owner

verified publisher icon egg-west

Metadata

Implementation and experiments for AdamW on Pytorch

Back