aisuite icon indicating copy to clipboard operation
aisuite copied to clipboard

Function calling support

Open controldev opened this issue 1 year ago • 4 comments

Is there any (plans for) function calling support? Without it, this has limited use in practical applications.

controldev avatar Nov 25 '24 19:11 controldev

Tool calling support is planned and under development. It will be supported shortly.

rohitprasad15 avatar Nov 25 '24 19:11 rohitprasad15

@rohitprasad15 I've been working on this multi-provider model calling topic in https://github.com/douglas125/SelfTestingGAT_LLM

maybe we could find a way to merge the 2 repositories in a way that I can focus on tools and aisuite can focus on the multi-providers?

I already added AWS Bedrock and function calling for many mainstream models, for example

douglas125 avatar Nov 25 '24 23:11 douglas125

Will the initial implementation support parallel (multiple) tool/function calling over streamed responses across all providers?

not-an-llm avatar Nov 26 '24 22:11 not-an-llm

Will the initial implementation support parallel (multiple) tool/function calling over streamed responses across all providers?

No, only one at a time at the moment. That's quite doable though

douglas125 avatar Nov 27 '24 00:11 douglas125