go-llm icon indicating copy to clipboard operation
go-llm copied to clipboard

Function calling wrapper to support non-function-calling LLM.

Open atljoseph opened this issue 1 year ago • 1 comments

Not all LLMs support calling functions in a robust way. Some providers like Ollama support json mode. Others don’t and have to rely on other parsing techniques, in addition to supporting many function calls, and possible streaming of scratchpad, etc. Happy with simple to start.

atljoseph avatar May 14 '24 17:05 atljoseph

Could basically augment how the OpenAI one works. Most providers have OpenAI-compliant APIs, save the functions. Quick change to OpenAI_api_base and voila.

atljoseph avatar May 14 '24 17:05 atljoseph