embeddedllm
embeddedllm copied to clipboard
[FEAT] Add NPU Engine
Is your feature request related to a problem? Please describe.
Intel has its own npu runtime library Reference : Phi-3 Cookbook - Intel NPU acceleration library
Describe the solution you'd like
Hence, NPU engine can be added to this repo
Additional context
Update in:
modelui.pyengine.pysetup.pyREADME.md
Add:
npu_egnine.pyrequirements-npu.txtnpu_models.md