ColossalAI-Examples icon indicating copy to clipboard operation
ColossalAI-Examples copied to clipboard

Provide relatively small model for ViT

Open Gy-Lu opened this issue 3 years ago • 0 comments
trafficstars

Describe the feature

Hi, I find that we have provided too many huge models as examples, for instance, we reshape cifar-10 to 224*224 and use ViT Huge(at least not tiny) to train. This reshape is quite redundant and so as ViT Huge for cifar-10.

Gy-Lu avatar Apr 29 '22 13:04 Gy-Lu