ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Currently, there is no support for gguf-based ollama-ipex-llm inference in jina-embeddings-v3 or jina-reranker-v2-base-multilingual. Do we have any plans to add this support in the future?

Open szzzh opened this issue 8 months ago • 0 comments

Currently, there is no support for gguf-based ollama-ipex-llm inference in jina-embeddings-v3 or jina-reranker-v2-base-multilingual. Do we have any plans to add this support in the future?

ollama-ipex-llm ollama-ipex-llm-2.2.0-ubuntu.tgz

model url: embedding model: https://huggingface.co/jinaai/jina-embeddings-v3 reranker model: https://huggingface.co/jinaai/jina-reranker-v2-base-multilingual

gguf model url: embedding model: https://huggingface.co/AgainstEntropy/jina-embeddings-v3-gguf reranker model: https://huggingface.co/gpustack/jina-reranker-v2-base-multilingual-GGUF

szzzh avatar Apr 10 '25 03:04 szzzh