SegVit icon indicating copy to clipboard operation
SegVit copied to clipboard

Asking about the class token.

Open kona419 opened this issue 1 year ago • 2 comments

Hello, https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/configs/base/models/seg_vit-b16.py#L24C9-L24C23

I found that you set with_cls_token=False. Is this means that ViT encoder in your model do not use class token, and use it for the decoder(ATM)?

kona419 avatar Dec 11 '23 12:12 kona419

We used the feature embedding from the VIT encoder without using the class token. Alternatively, we initialized a class embedding in the decoder in https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/decode_heads/atm_head.py#L239-L240

AkideLiu avatar Dec 15 '23 14:12 AkideLiu

We used the feature embedding from the VIT encoder without using the class token. Alternatively, we initialized a class embedding in the decoder in

https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/decode_heads/atm_head.py#L239-L240

Thank you for the reply! By the way, I was wonder when the SegViT2 especially Continual Learning part will be released.

kona419 avatar Dec 26 '23 01:12 kona419