vit-pytorch icon indicating copy to clipboard operation
vit-pytorch copied to clipboard

add an interpolate_embeddings helper function

Open DanTaranis opened this issue 2 years ago • 0 comments

This library is awesome. However I want to pretrain on small patches and then transfer learn on larger images. torchvision has a really great helper function for their vision transformer class : interpolate_embeddings.

"""This function helps interpolating positional embeddings during checkpoint loading,
    especially when you want to apply a pre-trained model on images with different resolution.

it would be awesome if your library also had something like that :)

DanTaranis avatar Dec 20 '22 09:12 DanTaranis