Jason Dai

Results 106 comments of Jason Dai

> Tried `ollama-ipex-llm-2.2.0b20250318-ubuntu.tgz`, I got: > > ``` > ❯ ./ollama run gemma3:4b > Error: llama runner process has terminated: error loading model: error loading model hyperparameters: key not found...

> > while the image input support is still WIP > > Yesterday I tried to run it directly through lama-сpp - and it worked (on 2-3x A770). > >...

> > Hi @Jianshui Based on our offline sync, we currently recommend using oneAPI 2024.0.1 If we upgrade to 2024.2 in the future, we will update you accordingly. > >...

Do you have an example huggingface hub link that we can test?

Please run the ENV-Check script in https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/scripts

> > To run ipex-llm ollama on your dGPU, you only need to install ipex-llm[cpp] > > Is there documentation that explains these options? What does installing ipex-llm[xpu] do that...