Olivier Chafik

Tried w/ `--samplers ""` and this time it's crashing on ``, which I'm not sure should have made it this far (maybe wrong token type in the GGUF?). Regardless, will...

Seems specific to DeepSeek-R1-Distill-Llama-8B-GGUF (the Qwen 7B & 32B distills don't crash with that grammar)

Oh, mine crashes w/ the following versions: ``` ./build/bin/llama-cli --version version: 4617 (90517ec4) built with Apple clang version 16.0.0 (clang-1600.0.26.6) for arm64-apple-darwin24.2.0 llama-cli --version # homebrew version: 4606 (a83f5286) built...

@phil-scott-78 thanks for reporting! Note that the Qwen distills should get better generally with https://github.com/ggerganov/llama.cpp/pull/11607 (although no changes related to grammar), and another possible thing might be the double bos...

Found at least one issue: if a token contains or completes a trigger *and* adds text that can't be parsed by the grammar, then kaboom (came up while testing upcoming...

Will close this as I can't repro the original issue, please feel free to open a new one if you still experience problems!

Apologies for this PR being a moving target. I've now stabilized things (except older gcc giving me sweats), added tests & included basic usage instructions (w/ a tiny agent helper...

> @ochafik Your `minja.hpp` is cool (I like minimalist things) Thanks @rujialiu ! > but if for any reason you need a lightweight but more powerful template engine, you can...

@Maximilian-Winter thanks / sorry for the slow reply! (frantically busy few weeks 😅) I'd love help on this, anything from just testing out instructions above, to finding new cool examples...

Hey @ngxson, thanks for the enthusiasm! As it turns out, I've just got the approvals today (🎉) from my employer to launch Minja in its own repo → https://github.com/google/minja (this...