ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Minicpm-V-2.6 Llama.cpp and Ollama Support

Open RobinJing opened this issue 1 year ago • 1 comments

Hi,

Minicpm-V is a very popular model these days, although it has not been supported by the current version of llama.cpp and ollama, please refer to the following submission: https://github.com/ollama/ollama/issues/6417 https://github.com/ggerganov/llama.cpp/releases/tag/b3598 BR

RobinJing avatar Aug 21 '24 07:08 RobinJing

Hi @RobinJing , ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with latest llama.cpp / ollama 😊

rnwang04 avatar Aug 27 '24 13:08 rnwang04