llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

common.cpp: add --enable-special-out and --disable-special-out for ov…

Open mofosyne opened this issue 1 month ago • 0 comments

…erride default special token handling behavior

Possible approach to address @HanClinto idea for a flag https://github.com/ggerganov/llama.cpp/pull/6923

Investigated using --conversation flag, but it touching multiple other logic so has much different semantic than this idea.

Also @jart would prefer keeping the different default special token behavior.

It would be nice if the 'settings' store has default behaviour + override flag... e.g. DEFAULT, OVERRIDE_TRUE, OVERRIDE_FALSE or something. But anyway this is the best approximation

mofosyne avatar May 18 '24 14:05 mofosyne