Vision-Transformer icon indicating copy to clipboard operation
Vision-Transformer copied to clipboard

Pytorch implementation of ViT on CIFAR-10.

Results 3 Vision-Transformer issues
Sort by recently updated
recently updated
newest added

Hi there! Thanks for this repository The code doesn't run though... Two issues that I found: 1. The model name in the file is ViT, while in the training file...

I sincerely hope that the author can complete the code

After running line 134 in the ViT forward: patches = images.unfold(2, self.patch_height, self.patch_width).unfold(3, self.patch_height, self.patch_width) I get a tensor with sizes ![image](https://user-images.githubusercontent.com/12126222/165741761-edb943ff-311b-4af4-943e-4e94d052379b.png) The next line is: patches = patches.permute(0, 2,...