ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

An error occurred while running mistral-nemo in ollama

Open brownplayer opened this issue 1 year ago • 4 comments

There is an error when running mistral nemo in ollama, but there is no problem when running qwen0.5b/It seems that ollama version is too low, how can I upgrade ollama version 屏幕截图 2024-08-25 142723

brownplayer avatar Aug 25 '24 06:08 brownplayer

Hi @brownplayer , the current version of ipex-llm ollama can be found in the Ollama QuickStart. We do not support users upgrading it themselves, but we will be updating the ollama version in recent days.

sgwhat avatar Aug 26 '24 02:08 sgwhat

That's great, thanks for your contributions, I can't wait to try the latest ollama

---- Replied Message ---- | From | SONG @.> | | Date | 08/26/2024 10:21 | | To | intel-analytics/ipex-llm @.> | | Cc | brownplayer @.>, Mention @.> | | Subject | Re: [intel-analytics/ipex-llm] An error occurred while running mistral-nemo in ollama (Issue #11917) |

Hi @brownplayer , the current version of ipex-llm ollama can be found in the Ollama QuickStart. We do not support users upgrading it themselves, but we will be updating the ollama version in recent days.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>

brownplayer avatar Aug 26 '24 02:08 brownplayer

Hi @brownplayer , ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with latest llama.cpp / ollama 😊

rnwang04 avatar Aug 27 '24 13:08 rnwang04

wow,it's so great

brownplayer avatar Aug 27 '24 14:08 brownplayer