TriDefender
TriDefender
Traceback is as followed, I was running ChatGLM4-9b-chat on my laptop. Device configurations OS: Win 11 23H2 (22631.3737) - CPU: i7-1260P - GPU: 'Intel(R) Iris(R) Xe Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu,...
## 🚀 Feature Addition of Qualcomm NPU devices inference ## Motivation Qualcomm released an AI sdk which includes ability for models to run on it's Qualcomm® Hexagon™ NPU, adding this...
### Checklist - [x] The issue exists after disabling all extensions - [x] The issue exists on a clean installation of webui - [ ] The issue is caused by...