ibot icon indicating copy to clipboard operation
ibot copied to clipboard

Bottleneck_ Dim=0 in iBOTHead

Open kffeng opened this issue 1 year ago • 0 comments

Hi, thank you for providing the code. I have a question about how to set the bottleneck_ dim=0 inDINOHeadand iBOTHead, there will be no self. last_ Layer=nn. utils. weight_ Norm (nn. Linear (bottleneck_dim, patch_out_dim, bias=False)) instead uses self.mlp2=nn Linear (hidden dim, patch_out_dim), I would like to know how much impact this will have on the model?

kffeng avatar Sep 13 '23 13:09 kffeng