ViT-pytorch
ViT-pytorch copied to clipboard
Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
Could you please provide me a test codes? !@jeonsworld @jeonsworld
thanks a million.
I was testing using the provided visualize_attention_map.ipynb The ViT-B_16-224 loads fine but when I downloaded and was loading ViT-H_14, it gave me the following error: ``` RuntimeError Traceback (most recent...
Here in the if condition [code](https://github.com/jeonsworld/ViT-pytorch/blob/main/train.py#L206), is check for (step+1) == len(trainset) missing? Reference --> [Reference code](https://kozodoi.me/python/deep%20learning/pytorch/tutorial/2021/02/19/gradient-accumulation.html)
Hi, thanks for releasing this code. I have tried to run the CIFAR-10 (as well as CIFAR-100) example, but in both cases the validation (and training) loss do not decrease,...
make a quick test file, might be of some use?
fix typo in comment
Maybe we should decrease the batch size by the value of `--train_batch_size` if We do not have enough memory?
Hi, I am using ViT-H_14 pre-trained to perform binary classification of biomedical images. The dataset I have available is very small: I use about 300 images to perform fine tuning...