litellm
litellm copied to clipboard
(feat) added experiemental guidance function calling
currently still in developement as it just uses LLamaCpp for now however this does indeed* work as it uses guidance to ensure that the function calling interface is preserved.
would love to see if any suggesting/help can be given to this as other LLMs are absolutely neccessary, this is just a temporary measure.
should not merge in current state
The latest updates on your projects. Learn more about Vercel for Git ↗︎
| Name | Status | Preview | Comments | Updated (UTC) |
|---|---|---|---|---|
| litellm | ✅ Ready (Inspect) | Visit Preview | 💬 Add feedback | Dec 27, 2023 8:59pm |