text-embeddings-inference icon indicating copy to clipboard operation
text-embeddings-inference copied to clipboard

Support for Minishlab's static models: model2vec/Potion

Open do-me opened this issue 1 year ago • 0 comments

Feature request

@MinishLab created really good and super small embedding models. I didn't find any other way to run these models in Rust so I thought it might be a good addition to TEI.

Citing from Huggingface:

the best small model in the world. 100-500x faster than a sentence-transformer, and almost as good.

References:

  • https://huggingface.co/minishlab
  • https://github.com/MinishLab

Motivation

It would be nice to have a really fast framework combined with really fast models to get the maximum out of it.

Your contribution

I'm new to Rust so I won't be of any help, but I'll ping the devs if there is any interest from their side to create a PR. For reference: https://huggingface.co/spaces/minishlab/README/discussions/1

do-me avatar Jan 13 '25 07:01 do-me