LIA icon indicating copy to clipboard operation
LIA copied to clipboard

The equivalent code of multi-layer MLP and One-layer Linear in class Encoder

Open junleen opened this issue 2 years ago • 2 comments

Hi, I found the activation in this sub-network is set as None. If it was None, the self.fc should equal to the cascaded multiple linear layer without activation, therefore equal to one Linear Layer? Is it right?

junleen avatar Sep 16 '22 12:09 junleen

same question

TaekyungKi avatar Sep 25 '22 02:09 TaekyungKi

I agree.

ivan-alles avatar Feb 28 '23 05:02 ivan-alles