llama.cpp icon indicating copy to clipboard operation
llama.cpp copied to clipboard

Misc. bug: missing chat-template support in llama-run

Open engelmi opened this issue 1 month ago • 1 comments

Name and Version

$ llama-cli --version version: 4460 (ba8a1f9c) built with cc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0 for x86_64-linux-gnu

Operating systems

Linux

Which llama.cpp modules do you know to be affected?

Other (Please specify in the next section)

Command line

llama-run granite-code

Problem description & steps to reproduce

The llama-run CLI currently doesn't take the chat template of a model into account. Thus executing llama-run on a model requiring such a template will fail.

First Bad Commit

No response

Relevant log output

failed to apply the chat template

engelmi avatar Jan 10 '25 15:01 engelmi