llama-cpp-agent icon indicating copy to clipboard operation
llama-cpp-agent copied to clipboard

Add support for openAI LLM

Open Anash3 opened this issue 1 year ago • 3 comments

Anash3 avatar Jun 28 '24 17:06 Anash3

OpenAI now supports Structured Outputs mode in its API. This may be very compatible with llama-cpp-agent; it would be helpful to have such an option to allow people without GPUs to use the application. https://openai.com/index/introducing-structured-outputs-in-the-api/

umiyuki avatar Aug 07 '24 04:08 umiyuki

@umiyuki I'm working on a unified framework https://github.com/Maximilian-Winter/ToolAgents

Maximilian-Winter avatar Aug 07 '24 13:08 Maximilian-Winter

I was not aware of the ToolAgents project. Great project! Looks very good.

umiyuki avatar Aug 08 '24 02:08 umiyuki