ibot
ibot copied to clipboard
Bottleneck_ Dim=0 in iBOTHead
Hi, thank you for providing the code. I have a question about how to set the bottleneck_ dim=0
inDINOHead
and iBOTHead
, there will be no self. last_ Layer=nn. utils. weight_ Norm (nn. Linear (bottleneck_dim, patch_out_dim, bias=False))
instead uses self.mlp2=nn Linear (hidden dim, patch_out_dim)
, I would like to know how much impact this will have on the model?