xlnet-Pytorch icon indicating copy to clipboard operation
xlnet-Pytorch copied to clipboard
verified publisher icon graykode

position-wise feedforward only one linear layer?

Open yuanenming opened this issue 4 years ago • 0 comments

https://github.com/graykode/xlnet-Pytorch/blob/cb793a1c75bdc59e3360f04ec641af726719811f/xlnet.py#L163

In your implementation, the FFN module only has one linear layer. is it a bug?

yuanenming avatar Jul 21 '21 11:07 yuanenming