[Feature Request]: Add note to docs that only some models support function calling

[davorrunje]

Is your feature request related to a problem? Please describe.

People asked for it on Discord after spending a lot of time trying to make it work with unsupported models.

Describe the solution you'd like

No response

Additional context

No response

[gagb]

Text in this notebook and the doc strings of methods exposed in this notebook seem like a good starting point for where to update the documentation? https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb

[qingyun-wu]

I think it also helps to have a place to document the models that are supporting function calls. Adding some here:

• fw-function-call-34b-v0 from fireworks: https://readme.fireworks.ai/docs/function-calling (OpenAI compatible!)
• https://huggingface.co/Trelis/Mistral-7B-Instruct-v0.2-function-calling-v3

[prithvi2226]

Is this issue still open or has been closed?? Thank you very much!

[davorrunje]

Looks like it is still open.

[yonitjio]

Please also add that function calling is also depends on AI platform. Even if the model can suggest function calling, if the AI platform doesn't support it then it won't work.

It seems some has tried Autogen with Ollama directly without realizing this. As of this writing, June 19, 2024, Ollama's Open AI implementation doesn't support function calling. https://github.com/ollama/ollama/blob/main/docs/openai.md

We do have documentation about this, but perhaps it needs to be moved to a more visible place.

https://microsoft.github.io/autogen/docs/topics/non-openai-models/local-litellm-ollama