Docker image (intelanalytics/ipex-llm-xpu): Documentation stated I would need to disable iGPU to use A770. When will you fix this issue since disabling iGPU is problematic?

[sungkim11]

Docker image (intelanalytics/ipex-llm-xpu): Documentation stated I would need to disable iGPU to use A770. When will you fix this issue since disabling iGPU is problematic?

[digitalscream]

What are you using it for? You might have some luck with setting this environment variable (after the setvars.sh and source ipex-llm-init lines):

export ONEAPI_DEVICE_SELECTOR=level_zero:0

Set it to level_zero:0 or level_zero:1, see if one of them works. I used this strategy when I was experimenting with dual A770s, one on x4 PCIE and one on x16.

More documentation here:

https://intel.github.io/llvm-docs/EnvironmentVariables.html

[liu-shaojun]

Hi @sungkim11 are you following this document: https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/docker_windows_gpu.html# to install IPEX-LLM in Docker, we will try to reproduce from our side and try the method suggested by @digitalscream.

[sungkim11]

Yes, I have followed the document. I am referencing the last section where it suggest I disable iGPU. This is problematic for me.

[liu-shaojun]

Hi @sungkim11

I tried running a Docker container (intelanalytics/ipex-llm-xpu) on a machine equipped with an A770 processor and integrated graphics (iGPU) following the steps in the documentation. After disabling the iGPU in the device manager, the chat service could start normally.

Although we also attempted method recommended by @digitalscream and method mentioned in the issue: https://github.com/intel/intel-extension-for-pytorch/issues/508,

export ZE_AFFINITY_MASK=0
or
export ONEAPI_DEVICE_SELECTOR=level_zero:1

it seems they all resulted in issues related to RuntimeError: could not create a primitive. https://github.com/intel/intel-extension-for-pytorch/issues/508#issuecomment-2097713733

Given this situation, I'd suggest sticking with the manual method of disabling the iGPU as outlined in the documentation. We'll update you in this issue if we discover any alternative solutions in the future. Apologies for any inconvenience caused.

[sungkim11]

This is problematic since my monitors are using iGPU, not A770. I would lose display when I disable iGPU.

[liu-shaojun]

We are working on a fix, and we'll update this issue when it's fixed. Alternatively, you can try using A770 for graphical interface support.