simclr icon indicating copy to clipboard operation
simclr copied to clipboard

About the training epochs

Open utjune opened this issue 2 years ago • 2 comments

I am a beginner who is just studying SSL. As far as I know, there are two training sessions in SSL. 1)One is the training the encoder in pretrain session, 2)the other is layer training in linear evaluation. In the figure 9 of this paper, there is a result with different batch size and epochs. In which training did you record the batch size and epoch? If it is the latter, what is the pretrained model used? ResNet-50 trained with ImageNet 1000epochs?

utjune avatar Sep 13 '22 02:09 utjune

batch size and epochs are meant for pretraining (of resnet-50).

On Mon, Sep 12, 2022 at 7:28 PM Joonsun Auh @.***> wrote:

I am a beginner who is just studying SSL. As far as I know, there are two training sessions in SSL. 1)One is the training the encoder in pretrain session, 2)the other is layer training in linear evaluation. In the figure 9 of this paper, there is a result with different batch size and epochs. In which training did you record the batch size and epoch? If it is the latter, what is the pretrained model used? ResNet-50 trained with ImageNet 1000epochs?

— Reply to this email directly, view it on GitHub https://github.com/google-research/simclr/issues/206, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAKERUJM5YJK6I4S6UGJDWTV57RENANCNFSM6AAAAAAQK773BI . You are receiving this because you are subscribed to this thread.Message ID: @.***>

chentingpc avatar Oct 11 '22 09:10 chentingpc

Then how many times last layer has been trained in step linear evaluation? When I operate the linear evaluation, last layer always has a training step. I can't find the number of epochs in linear evaluation.

Thank you.

utjune avatar Oct 12 '22 01:10 utjune