PyTorchText icon indicating copy to clipboard operation
PyTorchText copied to clipboard

use max-epoch5 v.s. early stop

Open yitang opened this issue 6 years ago • 1 comments

Hi, I am new to DL and i wonder what's the reason behind using small epoch (5) and not using early stop?

Thanks,

yitang avatar Mar 11 '18 00:03 yitang

Actually I use another kind of early stop:

  • if val acc rises: save the model, keep training
  • if val acc drops: load previous best model, decay lr

see here

5 epochs are not enough, Usually, I will finetune another 2 epochs with smaller lr.

chenyuntc avatar Mar 11 '18 03:03 chenyuntc