ipex-llm
ipex-llm copied to clipboard
Minicpm-V-2.5 Llama.cpp and Ollama Support
Hi,
Minicpm-V is a very popular model these days, although it has not been supported by the current version of llama.cpp and ollama, please refer to the following submission: https://github.com/ollama/ollama/issues/6307 https://github.com/ggerganov/llama.cpp/pull/7599
BR
Hi @RobinJing ,
ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with latest llama.cpp / ollama 😊