caido
caido copied to clipboard
Better support for openai-like providers and dynamic models in AI SDK
Community Note
- Please vote on this issue by adding a 👍 reaction to the original issue to help us know what to work on
- Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
Description
Right now we support an url in the openai provider, but it is a hack since you have to then call it like: openai/<MODEL CLEARLY NOT FROM OPENAI> and the plugins can't know those models.
I think we need to be able to add new providers and then call them like <provider-alias>/<optional sub model>/<model>.
We also likely need an API to retrieve a list of available models so the plugins can know what to display.
Use cases
- Better support of local models and proxies like litellm