detcon icon indicating copy to clipboard operation
detcon copied to clipboard

Published 20 hours ago • verified publisher icon google-deepmind

pretraining epochs

Open BostonCrayfish opened this issue 3 years ago • 2 comments

Hi, how many epochs have you pretrained for the resnet50 checkpoint you provided? I noticed that the ema of batch norm parameters was counted to 625568, but I don't know the batch size you used in pretraining.

BostonCrayfish avatar Feb 11 '22 11:02 BostonCrayfish

Hi, they've been trained for 1000 ImageNet epochs

olivierhenaff avatar Feb 11 '22 17:02 olivierhenaff

Got it! Thank you very much.

BostonCrayfish avatar Feb 12 '22 07:02 BostonCrayfish