ipex-llm
ipex-llm copied to clipboard
Does BigDL-LLM support Windows OS on Arc?
there is no windows version now for pip installation.
For running on GPU, we have internally build a windows build version, and the public version is work in progress. For running on CPU, it is already supported and you can directly install it with pip.
any chance the Windows code could be placed in a separate branch for testing? i was attempting to get it going, but ran into BigDL-core having only partial Windows support, and I suck at Maven
Which module in BigDL are you using to run on Windows?
For running on GPU, we have internally build a windows build version, and the public version is work in progress. For running on CPU, it is already supported and you can directly install it with pip.
Now for BigDL-LLM, we have already supported Windows on GPU, see more details and steps here: https://bigdl.readthedocs.io/en/latest/doc/LLM/Overview/install_gpu.html