how to use other versions of SAM2, such as the tiny version

[Deepleen]

Hello, I see that your work is for the large version of SAM2, but I currently need to experiment in the tiny version. I made changes to hieradet.py and image_encoder.py by referring to the tiny configuration in the official SAM2 code, and although the experiment works, the loss in the large version is small at the beginning, but the loss in the tiny version is more than 200 at the beginning. So may I ask what other work I need to do if I want to load the tiny version of SAM2 in the SAM2 adapter? I would appreciate if you could answer me.

Here's the loss drop for the tiny version of SAM2 adapter loaded with SAM2：

Here's the loss drop for the large version of SAM2 adapter loaded with SAM2：