RoFormer_pytorch icon indicating copy to clipboard operation
RoFormer_pytorch copied to clipboard

Published 20 hours ago • verified publisher icon JunnYu

生成近似句子太慢了，有加速的方法吗

Open shimachao opened this issue 1 year ago • 1 comments

我这边用3050 显卡生成30个近似句子需要1秒多，大家有加速的思路吗？

shimachao avatar May 06 '23 06:05 shimachao

是直接用的示例代码吗？可以改成batch输入

Hemeets avatar Jul 28 '23 09:07 Hemeets