João Vinholi

icon company Luxembourg Institute of Science and Technology icon location Luxembourg

Results 2 comments of João Vinholi

When did the optimizer switch to SGD？

There is no hard switch, but instead it is a smooth transition between the behavior of Adam and SGD.

Imaginary component 3.1913775165377e+114

Same problem for me. @zero-nnkn 's suggestion solved temporarily the issue.