pytorch-faster-rcnn icon indicating copy to clipboard operation
pytorch-faster-rcnn copied to clipboard

Why the validation error is lower than training error

Open VikrantKarale opened this issue 6 years ago • 1 comments

I have modified a original code so that I can plot training vs validation loss curves for the losses obtained after each epoch. But, I am getting validation loss less than training loss. I am plotting average training and validation loss (total loss divided by total images). The plot is shown below: error_adam_1e-8 Can anybody tell why it might be happening?

VikrantKarale avatar Oct 31 '18 17:10 VikrantKarale

in my opinion this is not overfitting but I have some recommends if you use NN: try and test these:

  1. don't use drop out in primary layers
  2. use low drop out or regularization(L1,L2) rate

SerajRzmi avatar Nov 17 '21 10:11 SerajRzmi