parseq icon indicating copy to clipboard operation
parseq copied to clipboard

Highly overfit to training dataset

Open kikirizki opened this issue 2 years ago • 2 comments

Hi @baudm thank you for your great works, I trained parseq-tiny model with Focused Scene Text Dataset + Incidental Scene Text Dataset, from (https://rrc.cvc.uab.es/), it contains around 4000+ images, after I trained for 300 epochs with default hyperparameter from this repo, it perform very well for training dataset and perform very poor for new unseen data, It seem the language model part overfit because when I tried new dataset, the wrong output usually are text that available in the training dataset, what do you think, do I need more dataset

kikirizki avatar Oct 24 '22 08:10 kikirizki

A dataset that small + training schedule that long would definitely result in overfitting.

  1. Don't use the default hyperparameters.
  2. Try decoding with decode_ar=False and refine_iters=0.

baudm avatar Nov 03 '22 09:11 baudm

@baudm Thank you so much for your response I will try it

kikirizki avatar Nov 03 '22 10:11 kikirizki