Vision-Transformer icon indicating copy to clipboard operation
Vision-Transformer copied to clipboard

Inconsistent name 'ViT' and Missing file 'transformers'

Open sptom opened this issue 2 years ago • 2 comments

Hi there!

Thanks for this repository The code doesn't run though... Two issues that I found:

  1. The model name in the file is ViT, while in the training file it's called as "ImageTransformer.ImageTransformer". But that's find, I changed it to "ImageTransformer.ViT". The patch size wasn't provided in the training file, but I put it in by adding patch_hight=config.patch_size, patch_width=config.patch_size.

  2. There isn't a file named "transformers" in the repository, but the train.py file does use it to create the scheduler with warmup. I tried t construct a warmup scheduler using pytorch ignite, but I'm not sure if it's consistent with your implementation. Please add transformers.py. (Please see image attached)

image

Thanks!

sptom avatar Apr 28 '22 11:04 sptom