Rex
Rex
yes we need this model
Yes, I can make mlc_llm support minicpm and minicpm-v, but I modified the script according to the official documentation.
Well, it works normally. I modified their mcl_llm toolkit. I can send you the kit if you want.
Yes, but instead of following their steps, I followed their source code to make changes to the mlc_llm tool
It works, I'll try to put the modified mlc_llm into my project, it may take a little while. Note that they are adapted to cu122 and cp310 linux systems
I put the modified mlc_llm toolkit on huggingface because github cannot accommodate large files: https://huggingface.co/spaces/Mos-fine/mlc_llm_Modify/tree/main @Nikhil34712
If you want to know how to modify the code inside, feel free to communicate with me. My company is trying to launch a private app model product that builds...
MLC-LLM is a great project, which will be an important excessive stage of AI mobile phones @tqchen
You can download those tools and unzip them to view them. If you want to know where I have changed specifically, you can take a look at my project [mlc_llm_Modify](https://github.com/mos-fine/mlc_llm_Modify...
There are two packages in hugging: mlc_llm_nightly_cu122-0.1.dev1352-cp310-cp310-manylinux_2_28_x86_64.whl and mlc_ai_nightly_cu122-0.15.dev404-cp310-cp310-manylinux_2_28_x86_64.whl. You can download them directly. After they get to your server, in cu122 and pip install them in the cp310 environment,...