JSFan

Hi, guys~ I solved this problem. That's a odd phenomenon in windows. The SRU is compiled when it is executed first time, so we need to set the MSVC in...

> > > Well same on linux > https://colab.research.google.com/drive/1Sk-XoxRcym9izg9wsnmKnAFL1CWXkzVL Maybe check compiler setting? ```apt-get install build-essential``` ? there is no any problem on my linux server (ubuntu and MacOS).

Download this file (MSVC Build Tool for 2017, Don't use 2019, it will failed) https://aka.ms/vs/15/release/vs_buildtools.exe And Install items (like this, sorry my language is Chinese) Finally, add (C:\Program Files (x86)\Microsoft...

Thanks for yours contribution. This is very useful for me, because it let my MacBook temperature lowered. I have a feedback. To make my MacBook temperature lowered, I would set...

Hi, @songkq , 也許你可以嘗試看看我的PR #41 ，裡面有一些實驗數據。 `/workspace/qwen.cpp/third_party/ggml/src/ggml-metal.m:1453: false` 應該是觸發 [`OOM`](https://github.com/ggerganov/ggml/blob/c0e1eb4414d18242daa0641ea8aa29be28f09d00/src/ggml-metal.m#L1446C43-L1446C55) 了

Try my PR? #39

Try my PR? #39