Vision-Transformer
Vision-Transformer copied to clipboard
Inconsistent name 'ViT' and Missing file 'transformers'
Hi there!
Thanks for this repository The code doesn't run though... Two issues that I found:
-
The model name in the file is ViT, while in the training file it's called as "ImageTransformer.ImageTransformer". But that's find, I changed it to "ImageTransformer.ViT". The patch size wasn't provided in the training file, but I put it in by adding patch_hight=config.patch_size, patch_width=config.patch_size.
-
There isn't a file named "transformers" in the repository, but the train.py file does use it to create the scheduler with warmup. I tried t construct a warmup scheduler using pytorch ignite, but I'm not sure if it's consistent with your implementation. Please add transformers.py. (Please see image attached)
Thanks!