micronet icon indicating copy to clipboard operation
micronet copied to clipboard

the stable of convergence

Open alexliyang opened this issue 3 years ago • 1 comments

I trained about 300 epoches, when I use the model to test , different epoches test results are very different , sometimes the result is good , sometimes the result is very bad, how to resolve this problem

alexliyang avatar Sep 29 '21 01:09 alexliyang

Yes, it is not that stable during training especially for the small model and the first hundreds of epochs. However, it will become more stable in the last 100 epochs when the learning rate is decayed to be very small.

liyunsheng13 avatar Sep 29 '21 17:09 liyunsheng13