Oscar

icon indicating a website link https://www.seu.edu.cn/

icon company Southeast University icon location China icon location Southeast University, mayjor in Computer Science.

Results 3 comments of Oscar

linear probe

Hi, @aaronsarna , I'm also curious about the linear probing, may I have your settings of final experiment? It seems that BatchNorm before the linear layer dosen't give a good...

linear probe

@aaronsarna Thanks for your reply. You mean the SimMIM baseline can't provide the performance in the paper without removing the attention on the mask tokens manually?

linear probe

Okay, thanks a lot for your help