mlc-llm
mlc-llm copied to clipboard
[Bug]
🐛 Bug
Phi 3.5 mini crashes mobile app
Expected behavior
Phi 3.5 mini saying Initialize and then crashes the mobile app
Environment
- Platform: Android
- Operating system: Android 14 (ColorOS 14)
- Device: Realme GT Neo 2
- How you installed MLC-LLM (
conda, source): Last Android apk release - How you installed TVM-Unity (
pip, source): ? - Python version (e.g. 3.10): latest idk
- GPU driver version (if applicable): Snapdragon 870 GPU
- CUDA/cuDNN: don't have
- TVM Unity Hash Tag (
python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))", applicable if you compile models):