firecoperana
Results
3
comments of
firecoperana
Try https://github.com/ikawrakow/ik_llama.cpp/pull/973. This brings back the context shift.
Do you want to log the prompt or the final generated message in verbose?
I can see the prompt logged when using text completions: `update_slots] prompt tokenized | tid="39232" timestamp="07:55:02" id_slot=0 id_task=0 n_ctx=32768 n_keep=0 n_prompt_tokens=26 prompt_tokens=.....`