PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

请问Paddle的TransformerEncoder没有实现Position Encoding的功能吗

Open psychocosine opened this issue 3 years ago • 1 comments

在ESIM模型中我尝试用TransformerEncoder去代替bi-lstm,发现效果更差了,而且训练变慢了。是因为没有做Position Encoding吗? ESIM

psychocosine avatar Aug 23 '22 12:08 psychocosine

paddle.nn.TransformerEncoder 仅包含 encoder 部分,不包含 embedding

FrostML avatar Sep 06 '22 11:09 FrostML

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

github-actions[bot] avatar Dec 08 '22 02:12 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。

github-actions[bot] avatar Dec 22 '22 16:12 github-actions[bot]