intel-device-plugins-for-kubernetes icon indicating copy to clipboard operation
intel-device-plugins-for-kubernetes copied to clipboard
verified publisher icon intel

NPU plugin support

Open tkatila opened this issue 7 months ago • 2 comments

tkatila avatar May 27 '25 12:05 tkatila

Not tested on real hardware. Development done based on the kernel API and example listings from a real system.

tkatila avatar May 27 '25 12:05 tkatila

I dropped the preferred allocation policy as it would require more than one NPU to exist and that's not expected as the NPUs are tied to CPUs.

tkatila avatar May 28 '25 12:05 tkatila

Tested the plugin on a MeteorLake hardware. Plugin works ok: it registers the resource, container requesting the resources is started, and container gets the /dev/accel/ devices. I also tried running some tests/demos. The results are mixed. Some pass while some don't.

I'll add a test Dockerfile into this PR and move this to "ready to review" state.

tkatila avatar Aug 05 '25 12:08 tkatila

Added a workload dockerfile and a job for it. The workload has a selection of tests that I've tested to work. There are also additional tests, but they require the NPU compiler & openvino runtime, which can be included, but they take such a long time to compile.

tkatila avatar Aug 05 '25 19:08 tkatila

Thanks for the review @eero-t. I fixed all but two that I objected to.

tkatila avatar Aug 12 '25 11:08 tkatila

Rebased against current main. I also verified that everything still works against a real hw.

tkatila avatar Aug 13 '25 07:08 tkatila