lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard

是否支持huggingface T5ForConditionalGenerartion的加速

Open czq1999 opened this issue 2 years ago • 0 comments

czq1999 avatar Aug 09 '22 09:08 czq1999

https://github.com/bytedance/lightseq/tree/t5_support 这个分支上有,还没merge到master

anaivebird avatar Aug 10 '22 09:08 anaivebird

导出可以用t5_support分支的lightseq/examples/inference/python/export/huggingface/hf_t5_export.py

推理用:lightseq/examples/inference/python/test/ls_t5.py

编译教程:https://github.com/bytedance/lightseq/blob/master/docs/inference/build.md

anaivebird avatar Aug 10 '22 09:08 anaivebird

master分支已支持

anaivebird avatar Aug 23 '22 08:08 anaivebird