glide icon indicating copy to clipboard operation
glide copied to clipboard

✨ Support Embedding API

Open roma-glushko opened this issue 2 years ago • 4 comments

Add a new set of API to support embeddings:

  • come up with the unified embedding request/response schemas
  • add a new model type to the routers config
  • define at least one provider with embedding capabilities

roma-glushko avatar Jan 06 '24 21:01 roma-glushko

Hello @roma-glushko,

Following up on our recent Discord thread, we are currently evaluating your project for a use case that involves Retrieval-Augmented Generation (RAG) and embedding as key components.

We are very excited about the LLMOps features in this project and would love to leverage them for our needs. Could you please let us know if the embedding API is planned for introduction in the near future?

Thank you for your assistance!

avinashkurup avatar Jun 13 '24 09:06 avinashkurup

Thank you so much, @roma-glushko, I will test this branch.

avinashkurup avatar Jun 27 '24 04:06 avinashkurup

Hey @avinashkurup I have not yet gotten the end to end flow, it's just an early draft with WIP right now. Just to be clear here.

roma-glushko avatar Jun 28 '24 10:06 roma-glushko

Thank you!!! @roma-glushko , Extremely sorry for the delay in communication. Will test this.

avinashkurup avatar Jul 31 '24 05:07 avinashkurup