lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard
verified publisher icon bytedance

推理加速效果不错，cpu 300%下降到40%，速度提升 3倍

Open ImmortalZ opened this issue 3 years ago • 1 comments

给个赞，bart模型 Pasted Graphic 7

用的很垃圾gpu 2080ti 速度从仅用gpu 0.67s 提升到 0.19s

ImmortalZ avatar Jul 29 '22 15:07 ImmortalZ

Thanks for your affirmation.

zjersey avatar Aug 11 '22 02:08 zjersey