[Feature]: Support "required" option in tool_choice
🚀 The feature, motivation and pitch
The documentation for tool calling mentioned:
The
tool_choiceoption "required" is not yet supported but on the roadmap.
This issue is used to track the support for the "required" option.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- [x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Can confirm this would be great, it's how pydantic-ai enforces result type check.
hey guys, this is crucial for agentic applications, why this is not in yet?
How is this not done yet? This is literally your #1 issue if you want vllm to be seriously used for any kind of agent tasks. (This is a similar problem for AG2, which is only as of like 0.8.4 from 4 days ago supporting "required")
Y'all can find time to merge the most insane MLA kernels to speedup deepseek but you don't have time to implement the literal most important feature of the year? Maybe sglang will be faster to implement this - and if they are, vllm will lose its relevancy as an inference engine for most open source agent AI companies
i will look into this