llama.cpp
llama.cpp copied to clipboard
common.cpp: add --enable-special-out and --disable-special-out for ov…
…erride default special token handling behavior
Possible approach to address @HanClinto idea for a flag https://github.com/ggerganov/llama.cpp/pull/6923
Investigated using --conversation flag, but it touching multiple other logic so has much different semantic than this idea.
Also @jart would prefer keeping the different default special token behavior.
It would be nice if the 'settings' store has default behaviour + override flag... e.g. DEFAULT, OVERRIDE_TRUE, OVERRIDE_FALSE or something. But anyway this is the best approximation