pytorch-image-models icon indicating copy to clipboard operation
pytorch-image-models copied to clipboard

[FEATURE] Modify SAM -> ViTDet

Open L-Reichardt opened this issue 1 year ago • 0 comments

Segment Anything (SAM) uses the ViTDet backbone [paper]. The only difference is that SAM adds a 3 layer neck. This neck can be disabled through arguments. By changing this 1 option, ViTDet can be reproduced.

However, ViTDet is originally meant as a feature pyramid network. That is the reason for its window strategy. "Features_only" should be supported by ViTDet / SAM.

L-Reichardt avatar Dec 16 '23 22:12 L-Reichardt