llama.clj icon indicating copy to clipboard operation
llama.clj copied to clipboard

Update llama.cpp to support newer Quen (3) models.

Open chromalchemy opened this issue 7 months ago • 0 comments

Getting and errror when trying to run Qwen 3 model, Following same approach as readme instructions.

Most models have a slightly different architecture which require llama.cpp to be updated. Depending on how new the model is, llama.cpp may require updating. If llama.cpp didn’t make breaking changes all the time, I would just publish a new build of the native library regularly.

chromalchemy avatar May 29 '25 16:05 chromalchemy