ipex-llm
ipex-llm copied to clipboard
Minicpm-V-2.6 Llama.cpp and Ollama Support
Hi,
Minicpm-V is a very popular model these days, although it has not been supported by the current version of llama.cpp and ollama, please refer to the following submission: https://github.com/ollama/ollama/issues/6417 https://github.com/ggerganov/llama.cpp/releases/tag/b3598 BR
Hi @RobinJing ,
ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with latest llama.cpp / ollama 😊