Custom Embedding Option

[ranjancse26]

Please rethink on the custom embedding options. Currently, based on the following documentation embeddings, I do not see a custom option other than Open AI embeddings ex: text-embedding-ada-002. It's always a good idea to have an option for the users to use their preferred embedding provider, say from Anyscale for example. Or it could be one of the hosted embedding providers.

[VisargD]

This might be a miss from our end in documenting embeddings models from other providers. We currently do support these providers apart from OpenAI for embeddings:

• Anyscale
• Azure-OpenAI
• Cohere
• Google
• MistralAI

We are open to add support for any new provider if we see any requests from users.

You can use all the above providers with same OpenAI signature. You will just have to change the virtual key header to the required provider's virtual key. Please let me know if you need any more help with this.

[ranjancse26]

@VisargD Request you guys to please keep the documentation up-to date to avoid any confusion. I am still confused on the usage of other 3rd party provider based embedding other than Open AI.