MAE-pytorch icon indicating copy to clipboard operation
MAE-pytorch copied to clipboard

Unofficial PyTorch implementation of Masked Autoencoders Are Scalable Vision Learners

Results 21 MAE-pytorch issues
Sort by recently updated
recently updated
newest added

Thank you for your contribution. I wonder if you plan to release the mask prediction visualization code?

enhancement

I eval vit_base of 500/1600 pretraining on imagenet1000 using knn metric. By loading all the pretained parameter with vit GAP method (not need cls token), the knn 20-NN result is...

enhancement

Hi again, sorry for the slow response in issue #26. I have some more clarifications and visualizations here. I agree that the sine-cosine embeddings are not learnable. However it seems...

enhancement

Running your code I faced with this problem. I check your code and see that you have local_rank instead. So please correct this error. ``` usage: MAE pre-training script [--batch_size...

It seems too slow to load data, and makes the gpu use rate is low.

Your work is so excellent! However, when I try to fine-tuning on my downstream regression task, I found that when using Mixup method, the parameter of the function contains: `num_classes=args.nb_classes`....

在dataset-folder中,import accimage cannot be parsedhow to solve it here def accimage_loader(path: str) -> Any: import accimage try: return accimage.Image(path) except IOError: # Potentially a decoding problem, fall back to PIL.Image...

![屏幕截图 2023-09-11 205322](https://github.com/pengzhiliang/MAE-pytorch/assets/122658071/98b95fc2-8f67-40d1-be0e-59e6b07fc874)

Hi, thanks for the nice code. How to implement Layer-wise learning rate decay on ResNet instead of ViT?