mlc-llm icon indicating copy to clipboard operation
mlc-llm copied to clipboard

Android application force closes

Open JackJollimore opened this issue 2 years ago • 5 comments

hi, my device is samsung s10+

the application downloaded parameters, and I see a message that shows ready for chat. I type any message, and send. I see my message is sent, and then the app for closes.

Thanks for any direction on this issue.

JackJollimore avatar May 09 '23 14:05 JackJollimore

Is your initial prompt large? That happens sometimes if my prompt is too large. It also helps to close all other apps in background.

GameOverFlowChart avatar May 09 '23 14:05 GameOverFlowChart

Is your initial prompt large? That happens sometimes if my prompt is too large. It also helps to close all other apps in background.

Thanks for your reply.

No, I am sending the message, 'hi'.

I've also closed all background apps to ensure it's not a ram issue.

edit: I cleared the cache & data. Redownloaded the parameters, and it continues force closing after sending hi.

ghost avatar May 09 '23 16:05 ghost

Error Code from logs: org.apache.tvm.Base$TVMError: ValueError: Check failed: (DataType(ptr->dl_tensor.dtype) == dtype) is false: at org.apache.tvm.Base.checkCall(Base.java:173) at org.apache.tvm.Function.invoke(Function.java:130) at ai.mlc.mlcchat.LLMChat.Encode(LLMChat.java:79)

georgejsh avatar May 11 '23 19:05 georgejsh

I have tried it in my Oneplus 8 Pro (Snapdragon™ 865) with 8GB RAM, It is crashing

devshafeeque avatar May 12 '23 12:05 devshafeeque

Seems error OOM

W Adreno-GSL: <gsl_ldd_control:549>: ioctl fd 58 code 0xc0300945 (IOCTL_KGSL_GPUOBJ_ALLOC) failed: errno 12 Out of memory E Adreno-GSL: <gsl_memory_alloc_pure:2354>: GSL MEM ERROR: kgsl_sharedmem_alloc ioctl failed. I SDM : HWCDisplayBuiltIn::GetOptimalRefreshRate: active_refresh_rate_: 60 W Adreno-GSL: <gsl_ldd_control:549>: ioctl fd 58 code 0xc0300945 (IOCTL_KGSL_GPUOBJ_ALLOC) failed: errno 12 Out of memory E Adreno-GSL: <gsl_memory_alloc_pure:2354>: GSL MEM ERROR: kgsl_sharedmem_alloc ioctl failed. E libc++abi: terminating with uncaught exception of type tvm::runtime::InternalError:

starlitsky2010 avatar May 15 '23 03:05 starlitsky2010

There doesn't seem to be a fix yet.

For your information, today I downloaded the apk and allowed it to download the parameters.

It says ready, I send, 'hi', then it closes.

ghost avatar May 24 '23 22:05 ghost

Exactly same issue here, snapdragon 855 Samsung S10, with 8G ram, check the chip supports OpenCL, but crashes too. But still excited and looking forward to deploying LLM on my phone natively, hope this issue can be fixed soon!!!!

jokerElsa avatar May 25 '23 03:05 jokerElsa

Seems like everyone is afraid of heavy-lifting on mobile, and the first message is always "hi". (but still crash)

jokerElsa avatar May 25 '23 03:05 jokerElsa

Closing due to lack of response.

ghost avatar May 25 '23 12:05 ghost