Khawar Islam

Results 85 comments of Khawar Islam

@forever208 Is it possible? If we use timm pre-trained weights in this code. The problem is that training takes alot of time.

@abhigoku10 Yes, y not https://github.com/rwightman/pytorch-image-models

Does anyone train Swin transformers with different image sizes? Like my image size is 112x112, it never works on this size

Hi All, Very good question. I have implemented 8 transformers and out of 7 VITs have a serious convergence problem. The dataset size is 97000 Regards, Khawar

Hi @eslambakr The best model is Praymid ViT Swin, CAIT, CrossViT, CeiT, ViT,NesT, PVT.

@eslambakr I am talking about below paper https://arxiv.org/abs/2102.12122

Hi @lucidrains you are right about compact transformer but a compact transformer is very efficient in training. They already sent you a Pull request. If possible for you, please add...

@stevenwalton that's great thank you

@Nial4 I am also facing the same for size 112 but still not working. Any advice?

I am encoding Kodak images with different sampling factor but my below command gives an error on "sampling-factor" for i in {01..24..1}; do echo JP2 Encoding test/images/kodim$i.png mkdir -p test/JP2/kodim$i...