ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

Does BigDL-LLM support Windows OS on Arc?

Open Fred-cell opened this issue 1 year ago • 5 comments

there is no windows version now for pip installation.

Fred-cell avatar Nov 23 '23 04:11 Fred-cell

For running on GPU, we have internally build a windows build version, and the public version is work in progress. For running on CPU, it is already supported and you can directly install it with pip.

hkvision avatar Nov 27 '23 06:11 hkvision

any chance the Windows code could be placed in a separate branch for testing? i was attempting to get it going, but ran into BigDL-core having only partial Windows support, and I suck at Maven

0xDEADFED5 avatar Dec 29 '23 07:12 0xDEADFED5

Which module in BigDL are you using to run on Windows?

hkvision avatar Jan 02 '24 02:01 hkvision

For running on GPU, we have internally build a windows build version, and the public version is work in progress. For running on CPU, it is already supported and you can directly install it with pip.

Now for BigDL-LLM, we have already supported Windows on GPU, see more details and steps here: https://bigdl.readthedocs.io/en/latest/doc/LLM/Overview/install_gpu.html

hkvision avatar Jan 02 '24 02:01 hkvision

there is no windows version now for pip installation.

@Fred-cell 三步完成在英特尔独立显卡上量化和部署 ChatGLM3-6B 模型

openvino-book avatar Jan 11 '24 23:01 openvino-book