gateway
gateway copied to clipboard
[Provider] Huggingface Text Embeddings Inference
https://github.com/huggingface/text-embeddings-inference
TEI is ideal for deploying rerank and embedding models, but it has its own rerank request format. Hopefully this project can support it
https://huggingface.github.io/text-embeddings-inference/#/Text%20Embeddings%20Inference/rerank