ViT-pytorch icon indicating copy to clipboard operation
ViT-pytorch copied to clipboard

Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

Results 29 ViT-pytorch issues
Sort by recently updated
recently updated
newest added

Could you please provide me a test codes? !@jeonsworld @jeonsworld

I was testing using the provided visualize_attention_map.ipynb The ViT-B_16-224 loads fine but when I downloaded and was loading ViT-H_14, it gave me the following error: ``` RuntimeError Traceback (most recent...

Here in the if condition [code](https://github.com/jeonsworld/ViT-pytorch/blob/main/train.py#L206), is check for (step+1) == len(trainset) missing? Reference --> [Reference code](https://kozodoi.me/python/deep%20learning/pytorch/tutorial/2021/02/19/gradient-accumulation.html)

Hi, thanks for releasing this code. I have tried to run the CIFAR-10 (as well as CIFAR-100) example, but in both cases the validation (and training) loss do not decrease,...

make a quick test file, might be of some use?

fix typo in comment

Maybe we should decrease the batch size by the value of `--train_batch_size` if We do not have enough memory?

Hi, I am using ViT-H_14 pre-trained to perform binary classification of biomedical images. The dataset I have available is very small: I use about 300 images to perform fine tuning...