AITemplate icon indicating copy to clipboard operation
AITemplate copied to clipboard

[ask] Does it also support conversion of large text models?

Open asynclee opened this issue 2 years ago • 1 comments

It's hard to find it in examples and documents, so I leave it as a question. Is the function and structure of AITemplate a structure that can convert and service large models such as opt-66b? Please let me know if the question lacks information. Thank you.

asynclee avatar Feb 16 '23 05:02 asynclee

Hi @asynclee, we don't have opt-66b in our examples, but feel free to try fx2ait or write your own AIT frontend for the opt-66b model.

ipiszy avatar Feb 21 '23 04:02 ipiszy