ImageNet21K icon indicating copy to clipboard operation
ImageNet21K copied to clipboard

Published 20 hours ago • verified publisher icon Alibaba-MIIL

Anyone here have trouble reaching the mentioned accuracy for ViT-B?

Open Phuoc-Hoan-Le opened this issue 2 years ago • 0 comments

Anyone here have trouble reaching the mentioned accuracy for ViT-B? For some reason, the best accuracy I can get is 77% top1 without KD. While in the paper they said they reach 81% top1 without KD and 84.4% top1 with KD. Anyone manage to get that accuracy? If so, can you tell me what hyperparameters did you use? Thanks!

Phuoc-Hoan-Le avatar Sep 20 '22 23:09 Phuoc-Hoan-Le