stable-diffusion-webui icon indicating copy to clipboard operation
stable-diffusion-webui copied to clipboard

[Feature Request]: Add support for Intel Ultra NPUs (AI Boost)

Open guillaume-rce opened this issue 1 year ago • 4 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

It would be interesting if NPUs from the new Intel Ultra processor range were added to the list of available devices. When I tested the OpenVINO toolkit, I saw that it was already supported, so why not add it to Stable diffusion Web UI?

Proposed workflow

Simply add the NPU to the device list

Additional information

No response

guillaume-rce avatar Jul 08 '24 09:07 guillaume-rce

Do you think it'll work without any additional tweaks other than adding the device to the list?

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

It seems like they just get the list from your system. If you don't see NPU by using the command above, I guess you lack the drivers. https://github.com/openvinotoolkit/stable-diffusion-webui/blob/e5a634da06c62d72dbdc764b16c65ef3408aa588/scripts/openvino_accelerate.py#L1203

I can't check it myself because I'm on OpenSUSE, and I don't know if there's a way to install drivers on OSs other than Ubuntu.

ustas-eth avatar Aug 11 '24 19:08 ustas-eth

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

I saw "NPU" after running the command you mentioned, but "NPU" does not appear in SD Web UI.

p.s. Tested on Windows 11 with Intel Ultra 9 185H.

iamPorter avatar Aug 21 '24 09:08 iamPorter

NPU show up when upgrade openvino to 2024.4. but cannot get result with many torch.compile error.

btbxbob avatar Nov 14 '24 02:11 btbxbob

Can you see "NPU" in the list if you run python -c "from openvino import Core; print(Core().available_devices)"?

I saw "NPU" after running the command you mentioned, but "NPU" does not appear in SD Web UI.

p.s. Tested on Windows 11 with Intel Ultra 9 185H.

the requirement_version.txt require openvino version 2023.2, change to 2024.5 will work, but it will got torch.compile error

maxi201567 avatar Dec 09 '24 12:12 maxi201567