Support for Additional Inference Providers (DeepInfra, Hyperbolic) and Voyage AI for Embeddings

[xsayedmahmud]

Feature Description

Currently, the Vercel AI SDK supports Groq, Perplexity, and Fireworks as inference providers outside of major AI companies. However, these providers often lack a variety of new and fine-tuned models. DeepInfra and Hyperbolic offers a broader range of up-to-date models, making them a valuable addition.

Furthermore, Voyage AI provides some of the best-performing embedding models, including domain-specific ones for legal, finance, and more. Their model, voyage-large-2-instruct, outperforms current top OpenAI models in all cases, making it an excellent addition for embedding tasks.

Use Case

• Use DeepInfra and Hyperbolic for a wider selection of fine-tuned models, optimizing cost and performance.
• Leverage Voyage AI for superior embedding models in specialized fields like legal and finance.
• Utilize voyage-large-2-instruct for embeddings with better results than existing OpenAI models.

By supporting these providers, the ai SDK will offer more flexibility and model variety for developers.

Additional context

https://hyperbolic.xyz/

https://deepinfra.com/

https://www.voyageai.com/

[xl0]

@xsayedmahmud They all provide an openai-compatible API for chat, no need to add them explicitly, just set the base URL.

[xsayedmahmud]

@xl0 Hi, thanks for the suggestion! I hadn't considered that before, but I just tried it with the Hyperbolic OpenAI-compatible API, and it works. I initially thought only the providers directly mentioned in the AI SDK documentation would be compatible with it.

[lgrammel]

these could become 3rd party packages that implement the v2 specs for ai sdk 5. we can list them in the community providers section