parseq
parseq copied to clipboard
Highly overfit to training dataset
Hi @baudm thank you for your great works, I trained parseq-tiny model with Focused Scene Text Dataset + Incidental Scene Text Dataset, from (https://rrc.cvc.uab.es/), it contains around 4000+ images, after I trained for 300 epochs with default hyperparameter from this repo, it perform very well for training dataset and perform very poor for new unseen data, It seem the language model part overfit because when I tried new dataset, the wrong output usually are text that available in the training dataset, what do you think, do I need more dataset
A dataset that small + training schedule that long would definitely result in overfitting.
- Don't use the default hyperparameters.
- Try decoding with
decode_ar=False
andrefine_iters=0
.
@baudm Thank you so much for your response I will try it