llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard

How do I customize the Chat format?

Open lingyezhixing opened this issue 1 year ago • 0 comments

I'm trying to run CodeGeeX-4-all-9B, but the chat format it needs is like this:

[gMASK]{{ if .System }}<|system|> {{ .System }}{{ end }}{{ if .Prompt }}<|user|> {{ .Prompt }}{{ end }}<|assistant|> {{ .Response }}

lingyezhixing avatar Sep 02 '24 13:09 lingyezhixing