a-PyTorch-Tutorial-to-Image-Captioning icon indicating copy to clipboard operation
a-PyTorch-Tutorial-to-Image-Captioning copied to clipboard
verified publisher icon sgrvinod

Can't Reproduce Training

Open ryntwn88 opened this issue 4 years ago • 1 comments

I've been unable to train the model on the COCO dataset and achieve a BLEU-4 score above ~15. Anyone else experience this and find a solution?

I've made sure all the model and training setting are same as the author's instructions and even tried adjusting hyperparameters to see if something would work, but so far my best score is capped at 15. I can reproduce scores with the pretrained model and tested mixing my model with the authors WORDMAP and vis versa to confirm the problem is with my model training.

I am running on Windows, Python 3.6 with Pytorch 1.10 which is not same as author and needed to implement some of the fixes here in the issues (for example: setting workers to 0).

ryntwn88 avatar Dec 14 '21 02:12 ryntwn88

Have you solved the problem? I have the same problem with you as the BLEU-4 score capped at about 15-16.

Yingshu-Li avatar Dec 26 '21 08:12 Yingshu-Li