PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

请问Paddle的TransformerEncoder没有实现Position Encoding的功能吗

Open psychocosine opened this issue 2 years ago • 2 comments

我尝试用TransformerEncoder去代替bi-lstm,发现效果更差,而且训练变慢了。是因为没有做Position Encoding吗? image

psychocosine avatar Aug 22 '22 01:08 psychocosine

您好,我们已经收到了您的问题,会安排技术人员尽快解答您的问题,请耐心等待。请您再次检查是否提供了清晰的问题描述、复现代码、环境&版本、报错信息等。同时,您也可以通过查看官网API文档常见问题历史IssueAI社区来寻求解答。祝您生活愉快~

Hi! We've received your issue and please be patient to get responded. We will arrange technicians to answer your questions as soon as possible. Please make sure that you have posted enough message to demo your request. You may also check out the APIFAQGithub Issue and AI community to get the answer.Have a nice day!

paddle-bot[bot] avatar Aug 22 '22 01:08 paddle-bot[bot]

您好,NLP模型相关的问题建议去 PaddleNLP 提问哈:https://github.com/PaddlePaddle/PaddleNLP/issues

minghaoBD avatar Aug 23 '22 01:08 minghaoBD

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

github-actions[bot] avatar Dec 21 '22 00:12 github-actions[bot]

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

github-actions[bot] avatar Feb 27 '23 00:02 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。

github-actions[bot] avatar Mar 14 '23 00:03 github-actions[bot]