NAFNet
NAFNet copied to clipboard
About Conv Bias=True
I found that NafNet and HINet use the conv with bias=True. But the MPRNet used the conv with bias=False. Since the HINet shares the same multi-stage architectures as MPRNet, I wonder whether you have tried the conv with bias=False and choose conv with bias=True in HINet and NAFNet.
When conv is combined with different act layers (LeakyReLU, PReLU, SimpleGate, SE layer), there might be different results about the bias.
Hi, dmeatfloss, Thanks for your attention to NAFNet/HINet. We ablated the bias=True/False and did not see the advantage of bias=False in our experiments.