UGATIT-pytorch icon indicating copy to clipboard operation
UGATIT-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon znxlwm

Different setting of bias

Open Trueyellow opened this issue 5 years ago • 3 comments

Hi, here is another issue that, the TF version of UGATIT has bias in most of the layers (including Linear and Conv), but the torch version has no bias at all. Just wondering, if there is any difference?

Trueyellow avatar Aug 07 '19 07:08 Trueyellow

I have the same question.

cumtwb avatar Sep 18 '19 02:09 cumtwb

When we use BN layer after Conv or FC layer, the bias will be ignored.

hao-qiang avatar Dec 06 '19 11:12 hao-qiang

Well, there are plants of layers without BN in UGATIT like the CAM module. Anyway, to reproduce the TF version's result, this repo should be "fixed" in many details.

Trueyellow avatar Dec 09 '19 07:12 Trueyellow