llama.cpp
llama.cpp copied to clipboard
Misc. bug: missing chat-template support in llama-run
Name and Version
$ llama-cli --version version: 4460 (ba8a1f9c) built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu
Operating systems
Linux
Which llama.cpp modules do you know to be affected?
Other (Please specify in the next section)
Command line
llama-run granite-code
Problem description & steps to reproduce
The llama-run
CLI currently doesn't take the chat template of a model into account. Thus executing llama-run
on a model requiring such a template will fail.
First Bad Commit
No response
Relevant log output
failed to apply the chat template