autogen icon indicating copy to clipboard operation
autogen copied to clipboard

[.Net][Feature Request]: AutoGen.Ollama add tool call support

Open LittleLittleCloud opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

Ollama API now supports tools, update AutoGen.OllamaChatClient to support this latest feature as well.

https://github.com/ollama/ollama/blob/main/docs/api.md#chat-request-with-tools

In the meantime, it seems that ollama openai chat server also support tools now, so another workaround to try tool call in ollama is to connect to ollama openai api as a third-party openai endpoint using OpenAIChatAgent

Describe the solution you'd like

No response

Additional context

No response

LittleLittleCloud avatar Jul 26 '24 19:07 LittleLittleCloud

This issue is currently investigated by @DavidLuong98

LittleLittleCloud avatar Aug 08 '24 23:08 LittleLittleCloud

Wait for streaming=true has been enabled in ollama repo

  • https://github.com/ollama/ollama/issues/5989
  • https://github.com/ollama/ollama/issues/5796

LittleLittleCloud avatar Aug 21 '24 18:08 LittleLittleCloud

@lokitoth is this relevant to the agent chat version?

rysweet avatar Feb 17 '25 19:02 rysweet