mlc-llm
mlc-llm copied to clipboard
Android application force closes
hi, my device is samsung s10+
the application downloaded parameters, and I see a message that shows ready for chat. I type any message, and send. I see my message is sent, and then the app for closes.
Thanks for any direction on this issue.
Is your initial prompt large? That happens sometimes if my prompt is too large. It also helps to close all other apps in background.
Is your initial prompt large? That happens sometimes if my prompt is too large. It also helps to close all other apps in background.
Thanks for your reply.
No, I am sending the message, 'hi'.
I've also closed all background apps to ensure it's not a ram issue.
edit: I cleared the cache & data. Redownloaded the parameters, and it continues force closing after sending hi.
Error Code from logs: org.apache.tvm.Base$TVMError: ValueError: Check failed: (DataType(ptr->dl_tensor.dtype) == dtype) is false: at org.apache.tvm.Base.checkCall(Base.java:173) at org.apache.tvm.Function.invoke(Function.java:130) at ai.mlc.mlcchat.LLMChat.Encode(LLMChat.java:79)
I have tried it in my Oneplus 8 Pro (Snapdragon™ 865) with 8GB RAM, It is crashing
Seems error OOM
W Adreno-GSL: <gsl_ldd_control:549>: ioctl fd 58 code 0xc0300945 (IOCTL_KGSL_GPUOBJ_ALLOC) failed: errno 12 Out of memory E Adreno-GSL: <gsl_memory_alloc_pure:2354>: GSL MEM ERROR: kgsl_sharedmem_alloc ioctl failed. I SDM : HWCDisplayBuiltIn::GetOptimalRefreshRate: active_refresh_rate_: 60 W Adreno-GSL: <gsl_ldd_control:549>: ioctl fd 58 code 0xc0300945 (IOCTL_KGSL_GPUOBJ_ALLOC) failed: errno 12 Out of memory E Adreno-GSL: <gsl_memory_alloc_pure:2354>: GSL MEM ERROR: kgsl_sharedmem_alloc ioctl failed. E libc++abi: terminating with uncaught exception of type tvm::runtime::InternalError:
There doesn't seem to be a fix yet.
For your information, today I downloaded the apk and allowed it to download the parameters.
It says ready, I send, 'hi', then it closes.
Exactly same issue here, snapdragon 855 Samsung S10, with 8G ram, check the chip supports OpenCL, but crashes too. But still excited and looking forward to deploying LLM on my phone natively, hope this issue can be fixed soon!!!!
Seems like everyone is afraid of heavy-lifting on mobile, and the first message is always "hi". (but still crash)
Closing due to lack of response.