Support AI's other than OpenAI like Mistral

[elie222]

We use the ai package: https://sdk.vercel.ai/docs. And it's easy to switch between LLM's with it. Here's a playground for example: https://sdk.vercel.ai/

Although there may be features that don't work across LLMs like function calling. So we'd have to handle those differently.

If we could support Mistral that would be very cool and help us move in the direction of a 100% self-hosted version.

[Ravitejarao333]

can i work on this ?

[elie222]

Yes!

[varuntree]

This is a game changer i guess. Especially if we can do it with LLAMA 3 dont you think? I wonder why you chose mistral, i thinker if we can add llama from groq!

[ichiragkumar]

is this still open, can you please share more details about which all AI/ LLms you want to implement???

[elie222]

This is a game changer i guess. Especially if we can do it with LLAMA 3 dont you think? I wonder why you chose mistral, i thinker if we can add llama from groq!

Mistral/Llama 3. It can really be any model.

[elie222]

is this still open, can you please share more details about which all AI/ LLms you want to implement???

We added support for Anthropic/Bedrock a few months ago. Next would be supporting OS models. The Vercel ai package we use makes it pretty easy to do.

The main consideration is if the model supports function calling.