caido icon indicating copy to clipboard operation
caido copied to clipboard

Better support for openai-like providers and dynamic models in AI SDK

Open Sytten opened this issue 1 month ago • 0 comments

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help us know what to work on
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request

Description

Right now we support an url in the openai provider, but it is a hack since you have to then call it like: openai/<MODEL CLEARLY NOT FROM OPENAI> and the plugins can't know those models. I think we need to be able to add new providers and then call them like <provider-alias>/<optional sub model>/<model>. We also likely need an API to retrieve a list of available models so the plugins can know what to display.

Use cases

  • Better support of local models and proxies like litellm

Sytten avatar Nov 16 '25 21:11 Sytten