Cyril K

Add support for correct tool names

2

### Feature request Current implementation `1.4.5` does not return the correct tool name when using function calling. When returning a ToolCall, tool name is hardcoded to `tools`: https://github.com/huggingface/text-generation-inference/blob/4ee0a0c4010b6e000f176977648aa1749339e8cb/router/src/server.rs#L950 The name...

Add tool usage support with text-generation-inference integration from Hugging Face

4

# Description Integration of the latest functionality from `text-generation-inference` (starting from v1.4.3) which allows to use tools. Created a new `TextGenerationInference` class which builds upon `text-generation` classes (`Client` and `AsyncClient`)...

Running inference of QLoRA fine-tuned Llama-4 Scout does not work

6

### Please check that this issue hasn't been reported before. - [x] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Fine-tuned quantized Llama-4 Scout model...