MaskCLIP icon indicating copy to clipboard operation
MaskCLIP copied to clipboard

1 x 1 conv vs linear

Open Ming-er opened this issue 1 year ago • 1 comments

What's the different between 1 x 1 and linear? why should we do the replacement?

Ming-er avatar Jun 08 '23 09:06 Ming-er

@Ming-er I think the only difference between 1x1 conv and linear is that conv layer ignores the bias term in linear layer, and except that the calculation is the same. I'm curious about if the bias term will effect the final performance. Did you do some experiments to compare these two approaches?

Vincent-luo avatar Feb 28 '24 08:02 Vincent-luo