Khawar Islam
Khawar Islam
I tried 3 vision transformers and two vision transformers are working on the same dataset and coverage easily. Your NesT transformer is totally disconverge from the beginning and after 100...
Did you train these methods from scratch or finetune with their pre-trained checkpoints. It will be important sometimes. I am training from scratch Our scripts currently only train from scratch,...
@rishikksh20 @yutinyang I am also following the same error
@ChenyuChen1 Did you train a CeiT transformer from scratch?
@rishikksh20 Thank you. It works.
Install `pip3 install Pillow==9.2.0`
@XinWangg The author shared a trained model not a log and he also shared all steps but literally training on 1 million images takes a lot of time and GPUs...
@XinWangg you are right. It takes a lot of time Thank you @zhongyy
Thank you @zhongyy
Hi, I am doing it again and currently, the performance is below 60 in all datasets and batch count is ``` highest_acc: [0.5375, 0.5388333333333333, 0.5048333333333334, 0.517, 0.562142857142857, 0.5076666666666666] Epoch 1...