Temporal-Ensembling-for-Semi-Supervised-Learning icon indicating copy to clipboard operation
Temporal-Ensembling-for-Semi-Supervised-Learning copied to clipboard

Published 20 hours ago • verified publisher icon tensorfreitas

Unable to Reproduce Paper Results with Pi-Model

Open iamshahd opened this issue 2 years ago • 1 comments

Hi,

First of all, I'd like to thank you tremendously for sharing this clean TensorFlow implementation - it saved me a lot of time!

Second, I am wondering if by any chance you have compared your pi-model results with the original paper. I tried training the pi-model on SVHN using the same hyperparameters reported with 1000 labels, but for some reason the model overfits around the 50th-60th epoch, and the final test accuracy of the best ckpt is only 85%, versus almost 95% in the paper.

iamshahd avatar Sep 07 '22 22:09 iamshahd

Hi @iamshahd,

At the time I was not using a good GPU so I was not able to get the exact results as I stated in the docs:

The results are not exactly the ones reported in the paper with 1000 labels, but I have to admit that I do not have the hardware to find the best parameters with structured batches (the experiments were run in a 860M NVIDIA card).

With proper hyperparameter tuning it should be close to the reported results.

tensorfreitas avatar Sep 20 '22 15:09 tensorfreitas