mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard
verified publisher icon mlc-ai

[Bug] The Qwen2-1.5B-Instruct cannot run on Android phones with Huawei Mate50 (8gen1)

Open lengjing606 opened this issue 1 year ago • 4 comments

🐛 Bug

The Qwen2-1.5B-Instruct cannot run on Android phones with the Snapdragon 8 Gen 1 processor.

image

Environment

APP： Demo App download from https://llm.mlc.ai/docs/deploy/android.html Phone： HuaWei Mate50 Processor： Snapdragon 8 Gen 1 model： Qwen2-1.5B-Instruct-q4f16_1-MLC，download from https://huggingface.co/mlc-ai/Qwen2-1.5B-Instruct-q4f16_1-MLC

lengjing606 avatar Jul 11 '24 06:07 lengjing606

set convert template to chatml and retry

tombang avatar Jul 11 '24 13:07 tombang

Could you please try to run on different devices? Not sure but I heard that Huawei's OpenCL runtime is different from other android devices. And we did not test the package on Huawei devices

Hzfengsy avatar Jul 12 '24 04:07 Hzfengsy

@Hzfengsy The Redmi K50 also uses the Qualcomm Snapdragon 8 Gen 1 chip. I tested it on that device, and the same problem exists. image

lengjing606 avatar Jul 12 '24 08:07 lengjing606

Thanks for the feedback. We'll try to see if we can reproduce this error on our end.

MasterJH5574 avatar Jul 15 '24 13:07 MasterJH5574