genkit
genkit copied to clipboard
[FR] Support forced tool calling
Is your feature request related to a problem? Please describe. The Gemini API supports setting a "mode" for function calling: https://ai.google.dev/gemini-api/docs/function-calling#function_calling_mode
For example this allows the developer to choose whether the LLM output should only contain function calls, or if the LLM should decide whether to return text or a function call.
The googleai
plugin currently does not support tool_config
. This should be added to the custom model config.
Describe the solution you'd like
The mode could be specified during the generate()
call.
Describe alternatives you've considered N/A
Additional context N/A