lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard

Published 20 hours ago • verified publisher icon bytedance

Is it possible to accelerate mbart by lightseq?

Open GongCQ opened this issue 2 years ago • 2 comments

In mbart, there are two additional LayerNorm compared to bart. How can I modify the bart model in lightseq to support mbart? thanks!

GongCQ avatar Nov 04 '22 07:11 GongCQ

We do not currently support it. After we complete the development of the new architecture, we will find ways to support more models at a low cost.

hexisyztem avatar Nov 14 '22 04:11 hexisyztem

Wish that the acceleration of custom architecture will be supported soon

kuso2006 avatar Nov 23 '22 05:11 kuso2006