All-Hands-AI
Separate tool descriptions to support models with limited description length
- [ ] This change is worth documenting at https://docs.all-hands.dev/
- [ ] Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below
End-user friendly description of the problem this fixes or functionality that this introduces.
Give a summary of what the PR does, explaining any non-trivial design decisions.
This PR handles the max tool description length of 1024 characters for OpenAI's models by maintaining a separate simplified version for them.
CC: @xingyaoww @enyst
Link of any specific issues this addresses.
Fix #7167
Just a quick question before it slips my mind (sorry): if the user disables native tool use in configuration, what happens to the alternative definitions, are they picked up normally?
https://github.com/All-Hands-AI/OpenHands/blob/ec763f81051c65dea17ddd53556ceab8e73c6f6a/config.template.toml#L197
Just a quick question before it slips my mind (sorry): if the user disables native tool use in configuration, what happens to the alternative definitions, are they picked up normally?
I think with this PR OpenAI models like gpt-4o still pick up the simplified descriptions.
IMHO the question is: are we releasing now, if so, I think we should do this, even if this solution maybe would not be the same if we had more time to think.
Yeah I also discussed with @xingyaoww and this is more like a hotfix for now, we can improve on this in later PRs.