Meta-Weight-Net_Code-Optimization icon indicating copy to clipboard operation
Meta-Weight-Net_Code-Optimization copied to clipboard

Published 20 hours ago • verified publisher icon ShiYunyi

Is there possible to replace SGD with Adam

Open qwzlh opened this issue 3 years ago • 1 comments

Hi, thank you very much for the code. And, I wonder why you rewrite the SGD as MetaSGD and is there any possible to use the Adam algorithm while training the ResNet.

qwzlh avatar Dec 01 '21 14:12 qwzlh

Because the original paper used SGD. It can be replaced with adam.

ShiYunyi avatar Dec 02 '21 04:12 ShiYunyi