Michael Engel

I think we can close this if this is only about jinja templates and tool calling is asked for in #947. Closing. (@bentito please reopen if I misunderstood this issue)

> [@engelmi](https://github.com/engelmi) Any update on this? Unfortunately, I didn't have time to look at this. So if anyone else wants to take over and/or submit PRs, that would be awesome...

> Would it make more sense to allow the user to specify a chat template --chat-templat /tmp/chat.template? And then have --chat-template none or --chat-template default? Yes, I think having a...

@kush-gupt I think this is closely related to https://github.com/containers/ramalama/issues/2098 - be it local files from the ollama or hf cache or something else. I agree that having a hf cache...

@edmcman You can use the `--chat-template-file` option for `ramalama [run|serve]` to specify a custom (jinja) template. If you use the `--use-model-store` option, then ramalama will try to use the metadata...

> Yeah, part of the reason why I opened this issue was because a new user is not going to know about model store. I'm still a bit confused why...

I think we are passing `--jinja` for llama.cpp by default for quite a while now. And with #1732 we are passing the custom template of the model again. Not sure...

AFAIK the current `is_healthy` doesn't perform a `/health` or so API request, but checks if the expected model is listed in the `/models` API response. This is a special case...