Ask for MAE Pretrained Encoder used for weight initialization before training.

[Syloveslife]

[heyoeyo]

The code references the detectron2 github repo and the ViTDet models. There happens to be a set of download links for pretrained ViTDet models on that same repo: https://github.com/facebookresearch/detectron2/tree/main/projects/ViTDet

I don't know if they've explicitly said which set of weights they used as a starting point for SAM, but my best guess would be that it's one of the ViTDet models listed on that page (or something closely related).