NAFNet icon indicating copy to clipboard operation
NAFNet copied to clipboard

About Conv Bias=True

Open dasonglicu opened this issue 3 years ago • 1 comments

I found that NafNet and HINet use the conv with bias=True. But the MPRNet used the conv with bias=False. Since the HINet shares the same multi-stage architectures as MPRNet, I wonder whether you have tried the conv with bias=False and choose conv with bias=True in HINet and NAFNet.

When conv is combined with different act layers (LeakyReLU, PReLU, SimpleGate, SE layer), there might be different results about the bias.

dasonglicu avatar Aug 03 '22 13:08 dasonglicu

Hi, dmeatfloss, Thanks for your attention to NAFNet/HINet. We ablated the bias=True/False and did not see the advantage of bias=False in our experiments.

mayorx avatar Aug 09 '22 09:08 mayorx