text-embeddings-inference
text-embeddings-inference copied to clipboard
Support for Minishlab's static models: model2vec/Potion
Feature request
@MinishLab created really good and super small embedding models. I didn't find any other way to run these models in Rust so I thought it might be a good addition to TEI.
Citing from Huggingface:
the best small model in the world. 100-500x faster than a sentence-transformer, and almost as good.
References:
- https://huggingface.co/minishlab
- https://github.com/MinishLab
Motivation
It would be nice to have a really fast framework combined with really fast models to get the maximum out of it.
Your contribution
I'm new to Rust so I won't be of any help, but I'll ping the devs if there is any interest from their side to create a PR. For reference: https://huggingface.co/spaces/minishlab/README/discussions/1