PyTorch-BYOL icon indicating copy to clipboard operation
PyTorch-BYOL copied to clipboard

About STL10 top-1 accuracy

Open GA-17a opened this issue 4 years ago • 2 comments

Hi, thanks for your share. But I have a question about your STL10 top-1 accuracy. Is the accuracy '70.1' fine-tuning from your pre-trained model 'resnet-18_40-epochs' or training from scratch for 40 epochs?

GA-17a avatar Dec 22 '20 14:12 GA-17a

@GA-17a if you look in eval/eval.ipynb, it achieves a testing accuracy of 70.1%. However, the model .../resnet-18-80-epochs/.../model.pth is loaded. When I use the exact same script to pretrain the model using 40 epochs (i.e. training from scratch), I only achieve an accuracy of 66.5%. Seeing the other open issue, other people seem to have the same problem. Maybe there's an error in the documentation.

hafnerfe avatar Feb 03 '21 08:02 hafnerfe

@hafnerfe Thanks for your reply, and it solved my question.

GA-17a avatar Feb 04 '21 11:02 GA-17a