zhb-code

Results 14 comments of zhb-code

I have the same model as yours, the problem is the same, my model is Qwen1.5-1.8B-Chat-q4f16_1, error message: File "/path-to/mlc-llm/3rdparty/tvm/src/runtime/relax_vm/ndarray_cache_support.cc", line 255 at org.apache.tvm.Base.checkCall(Base.java:173) at org.apache.tvm.Function.invoke(Function.java:130) at ai.mlc.mlcllm.JSONFFIEngine.runBackgroundLoop(JSONFFIEngine.java:64) at ai.mlc.mlcllm.MLCEngine$backgroundWorker$1.invoke(MLCEngine.kt:42)...

Limited by the problem of mobile computing power, mobile phones are unlikely to deploy large-scale models for the time being. Therefore, the current mobile model cannot handle very professional and...

我自己用brew安装了openblas,还是报错

我按照你的方法,找到cblas.h文件,路径是:/opt/homebrew/Cellar/openblas/0.3.27/include, 然后在llm/llama.cpp/CMakeLists.txt中添加如下: ![1723195236547](https://github.com/user-attachments/assets/f8dcd9e0-8abd-491b-b16c-e7de7318f211) 然后执行go generate ./... 还是报那个错,CMakeLists.txt中刚添加的两句话也没了,CMakeLists.txt这个文件是不是受其他文件影响会自动修改?

还是不行,CMakeLists.txt中include对应的文件,一执行go generate ./...后,CMakeLists.txt刚加的那句include就自动没了,然后还是报这个错

是的,最终都会报错invalid logits id 10, reason: no logits,因为我一个月之前曾经跑起来2.5,后来更新代码之后,聊天就一直报这个,我看到bug链接了,只能等他们解决了

我当时就是因为报invalid logits id 10, reason: no logits这个错,才删掉之前编译好的,想重新拉取代码从头编译一次,结果就遇到了‘cblas.h’文件未找到这个问题,然后一直搞不定