Do I have to download the pre-training weights of VILT or the pre-training weights of VIT

[CQUTWangHong]

hello, I didn't use the pre-training weight of you provided, get the following error：

INFO - timm.models.helpers - Loading pretrained weights from url (https://github.com/rwightman/pytorch-image-models/releases/download/v0.1-vitjx/jx_vit_base_p32_384-830016f5.pth) Downloading: "https://github.com/rwightman/pytorch-image-models/releases/download/v0.1-vitjx/jx_vit_base_p32_384-830016f5.pth"

urllib.error.URLError: <urlopen error [Errno 110] Connection timed out>

[dandelin]

Hi @CQUTWangHong

Please check the URL is accessible from your server, our code internally uses timm's ViT weight.

[CQUTWangHong]

thks， can I download timm's ViT weight offline and run the code ？

[dandelin]

Yes, you can download it offline. If you put it in the cache directory that timm uses, I believe timm will not initiate the connection and use the pre-downloaded weight.