AITemplate
AITemplate copied to clipboard
[ask] Does it also support conversion of large text models?
It's hard to find it in examples and documents, so I leave it as a question. Is the function and structure of AITemplate a structure that can convert and service large models such as opt-66b? Please let me know if the question lacks information. Thank you.
Hi @asynclee, we don't have opt-66b in our examples, but feel free to try fx2ait or write your own AIT frontend for the opt-66b model.