SimMIM icon indicating copy to clipboard operation
SimMIM copied to clipboard

About mask_token in SimMIM codes

Open YangGangZhiQi opened this issue 1 year ago • 0 comments

Hi, thanks for this great work. After reading codes, I have a question about self.mask_token in SimMIM projects. What the role of self.mask_token in the init func of SwinTransformerForSimMIM? It sames like adding another learnable params in the model. what would happen if deleting this param? SimMIM_problems

Hope for your answer.

YangGangZhiQi avatar Feb 05 '24 07:02 YangGangZhiQi