distilabel icon indicating copy to clipboard operation
distilabel copied to clipboard

[FEATURE] add `llama-cpp` to `distilabel.embeddings`

Open davidberenstein1957 opened this issue 5 months ago • 1 comments

Is your feature request related to a problem? Please describe. It would be nice to intergrate https://llama-cpp-python.readthedocs.io/en/stable/#embeddings because of the speed of default sentence-transformers

Describe the solution you'd like similar class but different framework

Describe alternatives you've considered na

Additional context There are various GGUF sentence transformers available on the hub https://huggingface.co/models?library=sentence-transformers,gguf&sort=trending

davidberenstein1957 avatar Sep 09 '24 08:09 davidberenstein1957