Ruihang Lai
Ruihang Lai
I see. To help confirm the issue, could you help check the file `mlc_llm/nn/kv_cache.py` on your local side and see whether the Line 351 is the following? If it is...
@Vinaysukhesh98 @sygi could you share your commands to run things, together with the full logging? From the information we have so far I am unable to find the reason. Thanks...
Thank you @kenanor for bring this up. We have a pending PR here https://github.com/mlc-ai/mlc-llm/pull/2089
Hey @sherelynyap thanks for reporting. I feel that this issue might have been fixed by this commit https://github.com/mlc-ai/mlc-llm/commit/9037aae1bbda663f1ba41487b2ef073bc908ad50. Could you help confirm if your mlc_chat package is the latest? Or...
Hi @sherelynyap, from that msg I cannot directly tell if the compilation succeeded or not, since I didn't see the “error msgs” there before. Do you mind letting us know...
Hey @NSTiwari thanks for reporting. It looks to me that this is because your TVM is not the latest. To help confirm, could you check if the line 34 of...
Hello folks, sorry for the delayed response. Unfortunately I don't have enough bandwidth to build the android app. But you are more than welcome to coordinate here. As for the...
Hi @Jasmine090, thank you again for reporting. On one hand, we will need to need the GPU you are using before digging further. On the other hand, from the scripts...
Hi @Jasmine090 apologize for the late reply. MLC has changed a lot since April and just wonder if the latest pip package can work for you. I want to close...
Thank you @dusihuaxin for reporting. We will look into this.