SegVit
SegVit copied to clipboard
Asking about the class token.
Hello, https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/configs/base/models/seg_vit-b16.py#L24C9-L24C23
I found that you set with_cls_token=False. Is this means that ViT encoder in your model do not use class token, and use it for the decoder(ATM)?
We used the feature embedding from the VIT encoder without using the class token. Alternatively, we initialized a class embedding in the decoder in https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/decode_heads/atm_head.py#L239-L240
We used the feature embedding from the VIT encoder without using the class token. Alternatively, we initialized a class embedding in the decoder in
https://github.com/zbwxp/SegVit/blob/85616388cd8983e2d4daafd971540b210e956666/decode_heads/atm_head.py#L239-L240
Thank you for the reply! By the way, I was wonder when the SegViT2 especially Continual Learning part will be released.