AdamP icon indicating copy to clipboard operation
AdamP copied to clipboard

Published 20 hours ago • verified publisher icon clovaai
→

Metadata

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)

Results 1 AdamP issues
Sort by recently updated
recently updated
newest added

learning rate scheduler for adamp?

3 comment

Hi, From the paper you use cosine learning rate scheduler to train imagenet, did you apply both adamp and sgdp? what is your opinion about using constant learning rate scheduler...

twmht avatar twmht

← Metadata

410
Stars
54
Forks
Watchers

Owner

verified publisher icon clovaai

Metadata

AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights (ICLR 2021)

Back