go-llm
go-llm copied to clipboard
Function calling wrapper to support non-function-calling LLM.
Not all LLMs support calling functions in a robust way. Some providers like Ollama support json mode. Others don’t and have to rely on other parsing techniques, in addition to supporting many function calls, and possible streaming of scratchpad, etc. Happy with simple to start.
Could basically augment how the OpenAI one works. Most providers have OpenAI-compliant APIs, save the functions. Quick change to OpenAI_api_base and voila.