inference with windows issue

[Fred-cell]

install bigdl-llm on windows platform, and there is an issue as below: cannot find libintel-ext-pt-gpu.dll

[hkvision]

@leonardozcm Please take a look.

[MeouSker77]

This issue is caused by the lack of Visual Studio, and it has been solved.

As for the wrong output of whisper-base, could you share your code to run whisper-base and especially the commands you use so that we can reproduce it ? @Fred-cell

[cunkai]

我用Windows跑 https://github.com/pengyb2001/BigDL/tree/4ceec7b498d53403e28cf92c34756c2c06949614/python/llm/example/GPU/HF-Transformers-AutoModels/Model/yi 这个例子也是报错
File "C:\Users\cun\miniconda3\envs\bigllm\lib\site-packages\bigdl\llm\utils\ipex_importer.py", line 59, in import_ipex import intel_extension_for_pytorch as ipex File "C:\Users\cun\miniconda3\envs\bigllm\lib\site-packages\intel_extension_for_pytorch_init_.py", line 90, in raise err OSError: [WinError 126] 找不到指定的模块。 Error loading "C:\Users\cun\miniconda3\envs\bigllm\lib\site-packages\intel_extension_for_pytorch\bin\intel-ext-pt-gpu.dll" or one of its dependencies.

[Oscilloscope98]

Hi @cunkai,

This error is caused by some missing requirements in your environment.

You could refer to here for the detailed installation guide for BigDL-LLM on Windows GPU :) https://bigdl.readthedocs.io/en/latest/doc/LLM/Overview/install_gpu.html#windows; and the troubleshooting part shows the possible missing requirements in your env which could lead to this ipex import error.

Sorry for any confusion caused. We will update the examples to include more information regarding how to run them on Windows GPU. Here is one we have already updated: https://github.com/intel-analytics/BigDL/tree/main/python/llm/example/GPU/HF-Transformers-AutoModels/Model/chatglm2

Please let us know for any further questions :)

[cunkai]

Everything is running smoothly today. 今天运行没问题了