TriDefender

Native API returns: -2 (PI_ERROR_DEVICE_NOT_AVAILABLE)

8

Traceback is as followed, I was running ChatGLM4-9b-chat on my laptop. Device configurations OS: Win 11 23H2 (22631.3737) - CPU: i7-1260P - GPU: 'Intel(R) Iris(R) Xe Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu,...

[Feature Request] Addition of Qualcomm NPU devices inference

1

## 🚀 Feature Addition of Qualcomm NPU devices inference ## Motivation Qualcomm released an AI sdk which includes ability for models to run on it's Qualcomm® Hexagon™ NPU, adding this...