James Sheldon

icon indicating a website link https://contra.com/james_sheldon icon indicating an email [email protected]

icon company @cashew-research icon location Calgary, Alberta, Canada icon location Fullstack Engineer with 15 years of expertise specializing in the React/Typescript ecosystem.

Results 3 comments of James Sheldon

feat: ability to define fallback model / provider

Ya this is a 100000% required as an official library pattern. In my opinion any custom solution (thanks for sharing @e-simpson) seems like it would error prone to version change...

Groq models don't return the usage

I don't know if this is related but even the normal open models for streamObject return NaN for usage values.

Groq models don't return the usage

> @sheldonj for OpenAI it should work. In case you use `createOpenAI`, you need to set `compatibility` to `strict`: https://sdk.vercel.ai/providers/ai-sdk-providers/openai#provider-instance (this was necessary to prevent breaking changes with OpenAI-"compatible" providers)....