vit-pytorch icon indicating copy to clipboard operation
vit-pytorch copied to clipboard

Fine-tuning without loading position embedding from pre-trained model

Open Blosslzy opened this issue 4 years ago • 0 comments

Hi!
When fine-tuning in my own data set, can I just load the parameters of the encoder block from the pre-trained ViT-B? Thanks!

Blosslzy avatar Jan 02 '22 02:01 Blosslzy