mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

Can you give the code and guide for all models conversion?

Open ZSitong opened this issue 2 years ago • 4 comments

If you give the code of the model conversion, so that everyone can apply all the models according to the code and guide. ：）

ZSitong avatar May 04 '23 03:05 ZSitong

All codes, including model conversion codes, are in this repo. We are going to write tutorials soon

Hzfengsy avatar May 04 '23 04:05 Hzfengsy

look forward the tutorials

ZSitong avatar May 04 '23 04:05 ZSitong

All codes, including model conversion codes, are in this repo. We are going to write tutorials soon

The models seem to be constructed by relax API, instead of converting from original torch.nn.Module. Could you explain why not using existing relay frontend converter to get the model? Thanks

lixiaoquan avatar May 11 '23 07:05 lixiaoquan

As Relax has native dynamic shape support and modulized compilation flow, we won't waste our time on Relay in this project. And we are constructed by relax, because:

  1. We admit that relax does not have a well-done front-end importer
  2. LLM model are easy to write

Hzfengsy avatar May 11 '23 08:05 Hzfengsy