Daniel J Walsh
Daniel J Walsh
@giuseppe @nalind PTAL
@aaronlehmann still working on this?
If miloslav prefers 5452, I would go along with him. He is far smarter then me.
@bmahabirbu any movement on this?
Would it make more sense to allow the user to specify a chat template --chat-templat /tmp/chat.template? And then have --chat-template none or --chat-template default?
When running within the container, the --chat-template option would have to volume mount the path into the container. This would complicate the use of quadlets and kube.yaml, but for now...
@bmahabirbu Should this PR be closed or are you still working on it?
@olliewalsh Any chance this is fixed with latest changes for vllm?
@Split7fire still having this issue?
Could you update the version of RamaLama you are using, seems like ramalama 0.6.* We are getting ready to release 0.7.3?