linuxmagic-mp

[7977369.017102] usb 1-7: new high-speed USB device number 117 using xhci_hcd [7977369.165955] usb 1-7: New USB device found, idVendor=05ac, idProduct=1227 [7977369.165959] usb 1-7: New USB device strings: Mfr=2, Product=3, SerialNumber=4...

No, this isnt' a case of not using the right template, this is a case where tools can not be specified in a mistral .jinja template, and set the server...

Shipped with llama.cpp, ./models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja, this does NOT have tools, but assumes tools are already present in the prompt that the orchastrator rewrites to pass to the Mistral LLM (eg in...

I completely understand that.. FYI, I have spent over 30 hours carefully going over the underlying logic before I posted this as an issue. What you are describing is a...

Well, this 'should' be enshrined in the use of .jinja templates of course, for many reasons. If 'tools' is provided in the template, that should be treated the same as...

Close, and effectively yes ;) But I think this is a logic problem, so trying to figure out the 'intent' of the designers of llama-server, on how this should be...

This is why I am looking to guidance from the llama team. I have the option of patching in several ways, and could make a pull request, but need to...