Enabled native function calling for O1 + added support for reasoning_effort config in the config.
End-user friendly description of the problem this fixes or functionality that this introduces
- [X] Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below. The reasoning_effort parameter can be defined for the o1 family!
Give a summary of what the PR does, explaining any non-trivial design decisions
Added support for native function calling for O1 and added support for specifying the reasoning_effort in the configuration file.
Link of any specific issues this addresses
@AlexCuadron An alternative way to implement in llm.py is to set the new kwarg directly in the partial function, along with the other kwargs that we know at the time of init, then it all works the same. But I'm fine with the current PR implementation too.
I haven't tested it, but if you're happy with it, we can merge it?
@AlexCuadron An alternative way to implement in llm.py is to set the new kwarg directly in the partial function, along with the other kwargs that we know at the time of init, then it all works the same. But I'm fine with the current PR implementation too.
I haven't tested it, but if you're happy with it, we can merge it?
Thanks for the heads up! I tested 4o and o1 and both work without any issue. I can merge it after the tests are completed