mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

support for gguf embedding models

Open ericcarmi opened this issue 6 months ago • 1 comments

Hi, really appreciate the work on this project (the llama-cpp-rs crates are not great).

I would like to load a text embedding model such as: https://huggingface.co/nomic-ai/nomic-embed-text-v1.5-GGUF

I am open to other types of embedding models if nomic is not the right one. Also willing to investigate how to add this myself if I can get some pointers.

ericcarmi avatar Jul 30 '24 15:07 ericcarmi