ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

OSError: [WinError 127] AFTER RUN "from ipex_llm.transformers import AutoModel,AutoModelForCausalLM"

Open mygame182 opened this issue 9 months ago • 2 comments

Describe the bug OSError: [WinError 127] AFTER RUN "from ipex_llm.transformers import AutoModel,AutoModelForCausalLM"

How to reproduce Steps to reproduce the error:

  1. Install the ipex
  2. Install the ipywidgets
  3. Install the Pandas
  4. Run "from ipex_llm.transformers import AutoModel,AutoModelForCausalLM"

Screenshots If applicable, add screenshots to help explain the problem

Image

Additional context

OSError: [WinError 127] 找不到指定的程序。 Error loading "C:\Users\xxx\anaconda3\envs\llm\Lib\site-packages\intel_extension_for_pytorch\bin\intel-ext-pt-gpu.dll" or one of its dependencies.

mygame182 avatar Apr 06 '25 01:04 mygame182

Hi, seems there's something wrong for your ipex installation. Could you please provide more information:

  • The command you install ipex-llm. You don't need to install ipex manually, it will be installed automatically as a dependency of ipex-llm. The reference documentation is here: https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quickstart/install_windows_gpu.md#install-ipex-llm
  • Provide us with the results of pip list for us to check your Python environment?

Thanks!

hkvision avatar Apr 07 '25 02:04 hkvision

Thanks for hkvision.

I think I found the problem and solved it :

When I finish the install of ipex, it can run the test code normally. Then I try it in a CUDA code program, instead by IPEX. When I run the model training code in the first time, the program just hang up in a few minutes. But I INTERRUPT THE PROGRAM MANUALLY. Then it show the OSError. So I think that's the reason.

Now I reinstall the ipex and everything goes well.

mygame182 avatar Apr 07 '25 03:04 mygame182