ramalama icon indicating copy to clipboard operation
ramalama copied to clipboard

Any plans to incorporate ipex-llm

Open mecattaf opened this issue 9 months ago • 1 comments

I see the support for openvino, are there any plans to support https://github.com/intel/ipex-llm It has been reported to me that ollama+ipex-llm is very fast on intel ultra iGpu

mecattaf avatar Mar 31 '25 20:03 mecattaf

PRs welcome @mecattaf

ericcurtin avatar Mar 31 '25 20:03 ericcurtin

Why did you close the issue? I'm struggeling with current intel-gpu integration and ipex-llm might be the solution. See my comment here.

Maybe have a look at

https://github.com/eleiton/ollama-intel-arc and how this project incoperates ipex-llm. This is docker image works for me but I would prefer to use ramalama if ipex-llm support is possible.

tristan-k avatar Jul 21 '25 17:07 tristan-k