Sigbjørn Skjæret

Results 133 comments of Sigbjørn Skjæret

> @CISC The issue with the Qwen models was that chat_formatter was calling `comon_chat_parse` on user messages and the content was being placed into "reasoning content"—hence the empty content! Thanks...

> I set --reasoning-budget 0 and it outputs the reasoning as a regular assistant message. Is this expected? I am using `$ ./build/bin/llama-cli.exe -m Qwen_Qwen3-4B-Thinking-2507-Q8_0.gguf -p "What is nine plus...

> In addition, I added "Thinking ..." prefix and "...\n\n" suffix, but I am open to changing those. Another possibility could be something like: "[Thinking: ... ]" which seems maybe...

> @CISC What do you think of these? If we want something terse, maybe a specific glyph might be best to convey the meaning: > ## Logic/Math symbols (most thematically...

> Here are a few of the screenshots. I tend to agree that the double-arrow has the right contextual meaning and sufficient visual prominence. The other symbols kind of sink...

> > I think it should also be prepended to the regular output to better mark the separation > > How do you mean? Please show an example. I simply...

> And then building on it, with tool calls it would be something like `[Calling tool: get_weather]`. I actually have that implemented with a Tcl interpreter already (pending a much-delayed...

> ``` > $ gguf-dump --help > Traceback (most recent call last): > File "/nix/store/l06dc60pbanrbm5ksvf0wh3n2q9blw4z-python3.12-gguf-0.0.0/bin/.gguf-dump-wrapped", line 6, in > from gguf.scripts import gguf_dump_entrypoint > File "/nix/store/l06dc60pbanrbm5ksvf0wh3n2q9blw4z-python3.12-gguf-0.0.0/lib/python3.12/site-packages/gguf/scripts/__init__.py", line 9, in >...

> Interesting, so this is clearly a problem with the way the entrypoints are all made from the same `__init__.py`, which perhaps is not ideal anyway? Is there a better/simpler...

@compilade Looking at the commit history I think it sort of just evolved into this without any serious consideration as to why, I think clearing `__init__.py` and pointing directly to...