ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard
verified publisher icon intel-analytics

(PI_ERROR_DEVICE_NOT_FOUND) llama_load_model_from_file: exception loading model

Open sundeepChandhoke opened this issue 1 year ago • 2 comments

I am getting this error after installing the IPEX_LLM and onAPI. I can successfully serve ollama and pull models. But when I try to run any model, I get this error.

sundeepChandhoke avatar Jul 18 '24 01:07 sundeepChandhoke

I do not have any Intel GPU on this machine. So maybe it is expecting a GPU? I am trying to test AMX instructions on the 4th gen Xeon processor

sundeepChandhoke avatar Jul 18 '24 01:07 sundeepChandhoke

Hi @sundeepChandhoke , yes ollama is expecting a gpu and it does not support running on a device without any gpu currently.

sgwhat avatar Jul 18 '24 02:07 sgwhat