vision-transformer-pytorch
vision-transformer-pytorch copied to clipboard
asyml
Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML project.
**Is your feature request related to a problem? Please describe.** Fine-tuning on CIFAR-100 **Describe the solution you'd like** Could you please provide hyper-parameters for fine-tuning CIFAR-100? Particularly, could you give...
Thank you for your great work. Would you please post your training scripts to train the model on ImageNet. For example the learning rate, weight decay, training_step and etc? Thank...
Thank you for your great work. I wonder what is the performance on train from scratch for cifar10 & cifar100? Seems this model heavily relies on the pretrained weights.
I found that Google has updated the R50+ViT-B/16 hybrid model. Can the pytorch version also be updated?
hi , im really preciated by the work. but i have a question about "pre_logits". Did you set the "**representation_size**" as defualt **None** when you finetune **imagenet21k_ViT-B_16.npz** with **imagenet 1k**?...
