mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Published 20 hours ago • verified publisher icon mlc-ai

The output issues encountered when deploying on iPhone.

Open cvv-student opened this issue 2 years ago • 0 comments

I successfully deployed LLM on iPhone 12 Pro without any errors, but the output results are garbled. I think it might be an issue during model quantization, but I have no experience with deploying using TVM. Where should I start to solve this problem? IMG_4718

cvv-student avatar May 18 '23 11:05 cvv-student