mlc-llm
mlc-llm copied to clipboard
mlc-ai
Universal LLM Deployment Engine with ML Compilation
I try to build model for android according to the guide. when i run ./prepare_libs.sh fail, error message: ``` ➜ android git:(main) ./prepare_libs.sh + rustup target add aarch64-linux-android info: component...
I asked this question as a followup to a previous [issue](https://github.com/mlc-ai/mlc-llm/issues/116) (now closed). Apologies for the duplication - just wanted to make sure it gets visibility. I'm able to build...
Trying to install this on a Jetson Orin NX 16Gb. I get the following error: ``` $ conda install -c mlc-ai -c conda-forge mlc-chat-nightly Collecting package metadata (current_repodata.json): done Solving...
It seems like if an output is too long, that the ai doesn't have any memory about the passed conversation anymore. Instead the passed conversation should be cropped so that...
I get the following error when I follow the instructions from the webpage for my M1 Mac ```(mlc-chat) (....) MacBook-Pro local_chat % mlc_chat_cli Cannot find vicuna-v1-7b lib in preferred path...
This PR allows us to pass in a HF URL (for example, `lmsys/vicuna-7b-delta-v1.1`) to `build.py` so the user does not need to manually download weights.
For large custom data stored on device (pdf, text, xml), how to turn custom large data into text embeddings and store them locally on device via vector database. Then perform...
I followed instructions in [iOS]( https://github.com/mlc-ai/mlc-llm/blob/main/ios/README.md) M1 Ventura 13.5 btw: What should I do to resolve this issue?
