lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard

Published 20 hours ago • verified publisher icon bytedance

性能问题

Open 520jefferson opened this issue 3 years ago • 1 comments

是否有和tensorrt8.0和fasttransformer4.0做过对比？这写都有一些更新，比如int8推理，比如优化了BS。 另外，有没有实际推理优化的数据，特别是针对大模型，几十亿，上百亿甚至更大的做过试验

520jefferson avatar Dec 17 '21 04:12 520jefferson

There is no update yet to compare with the latest tensorrt and fastertransformer, we will update it in two months LightSeq does not currently support large models

neopro12 avatar Dec 22 '21 10:12 neopro12