PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

请问paddlenlp 有没有非自回归的语言模型

Open dlkht opened this issue 3 years ago • 4 comments

请提出你的问题

比如做到并行解码的

dlkht avatar Oct 19 '22 08:10 dlkht

能列举一下想要的模型吗?

wawltor avatar Oct 19 '22 09:10 wawltor

能列举一下想要的模型吗?

比如论文 ACL2021 "Glancing Transformer for Non-Autoregressive Neural Machine Translation"实现的模型

dlkht avatar Oct 19 '22 11:10 dlkht

Non-Autoregressive

目前在机器模型翻译的模型中我们目前还没有Non-Autoregressive的模型,目前还是依赖于token by token,不过目前这种模型整体而言效果还是比 Non-Autoregressive 效果好点

wawltor avatar Oct 19 '22 13:10 wawltor

如果是说觉得自回归速度慢希望更快的生成的话,PaddleNLP针对GPU环境是有预测加速支持的可以试下

guoshengCS avatar Oct 20 '22 08:10 guoshengCS

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

github-actions[bot] avatar Dec 20 '22 00:12 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。

github-actions[bot] avatar Jan 04 '23 00:01 github-actions[bot]