pytorch-semseg icon indicating copy to clipboard operation
pytorch-semseg copied to clipboard

Saving one ReLU operation in bottleNeckPSP and bottleNeckIdentifyPSP?

Open kame-hameha opened this issue 6 years ago • 0 comments

Is there a reason for not using 4 ReLUs in the bottleNeckPSP class? In utils.py#614, you are using self.cb3 = conv2DBatchNorm instead of another conv2DBatchNormRelu?: --> three ReLUs + another ReLU for bottleNeckPSP
--> three ReLUs + an identity for bottleNeckIdentifyPSP):

Am I right that you are computing the ReLU for the third conv plus for the identity together; so you first add them and then do the ReLU operation utils.py#630

Are you saving one ReLU operation in that way?

kame-hameha avatar Oct 04 '19 22:10 kame-hameha