litellm icon indicating copy to clipboard operation
litellm copied to clipboard

(feat) added experiemental guidance function calling

Open danikhan632 opened this issue 2 years ago • 1 comments

currently still in developement as it just uses LLamaCpp for now however this does indeed* work as it uses guidance to ensure that the function calling interface is preserved.

would love to see if any suggesting/help can be given to this as other LLMs are absolutely neccessary, this is just a temporary measure.

should not merge in current state

danikhan632 avatar Dec 27 '23 20:12 danikhan632

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 27, 2023 8:59pm

vercel[bot] avatar Dec 27 '23 20:12 vercel[bot]