mlc-llm
mlc-llm copied to clipboard
mlc-ai
Universal LLM Deployment Engine with ML Compilation
hi, my device is samsung s10+ the application downloaded parameters, and I see a message that shows ready for chat. I type any message, and send. I see my message...
Crashes when sending a message on the exynos version of the s22 ultra on android 13, prompt length doesnt matter Device Info ``` Device -------------------------------------------------------- Device Name : Galaxy S22...
I run: conda install -c mlc-ai -c conda-forge mlc-chat-nightly ``` Collecting package metadata (current_repodata.json): failed # >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT
1. the ability to stop the ai from writing 2. the ability to regenerate the last answer 3. the ability to edit your own prompt and get a new answer...
This is a list of the problems with the Android gui. 1. Top bar is too large (it takes unnecessarily much space from the small phone screen) 2. Top bar...
This PR updates the Android build-from-source instructions. Some dependency steps were missed previously.
When I build apk met this problem? Could give me some tips about it? > Task :app:generateJniHeaders FAILED /home/user/Workspace/Projects/NLP/mlc-llm/android/MLCChat/app/../../build/tvm_home/jvm/core/src/main/java/org/apache/tvm/LibInfo.java:44: error: package Base does not exist native int tvmFuncGetGlobal(String name, Base.RefLong...
I want to run vicuna-7b on nv gpu based on mlc-llm. I followed the [intruction](https://github.com/mlc-ai/mlc-llm/blob/main/ios/README.md) and have some changes: 1. Install relax. ``` git clone https://github.com/mlc-ai/relax.git --recursive cd relax mkdir...
Running the Android app on my OnePlus 7 Pro (8Gb RAM) causes the phone to become nearly unresponsive. I am unable to bring up the keyboard, gesture controls fail, and...
when i exec mlc_chat_cli,i meet the mistake. Cannot find vicuna-v1-7b lib in preferred path "dist/vicuna-v1-7b/float16/vicuna-v1-7b_metal_float16.dylib" or other candidate paths%
