lightseq
lightseq copied to clipboard
是否支持huggingface T5ForConditionalGenerartion的加速
https://github.com/bytedance/lightseq/tree/t5_support 这个分支上有,还没merge到master
导出可以用t5_support分支的lightseq/examples/inference/python/export/huggingface/hf_t5_export.py
推理用:lightseq/examples/inference/python/test/ls_t5.py
编译教程:https://github.com/bytedance/lightseq/blob/master/docs/inference/build.md
master分支已支持