text-embeddings-inference icon indicating copy to clipboard operation
text-embeddings-inference copied to clipboard

Multiple Model Endpoint support

Open ruifengma opened this issue 9 months ago • 0 comments

Feature request

Hello, My question is that if/how we support multiple models selection by a single api endpoint. For example, I have gte, bge etc. and I can deploy them together with the same url and switch easily among these model?

Motivation

support multiple models

Your contribution

Something like the fastchat controller register

ruifengma avatar Apr 29 '24 02:04 ruifengma