embeddedllm icon indicating copy to clipboard operation
embeddedllm copied to clipboard

[FEAT] Add NPU Engine

Open szeyu opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

Intel has its own npu runtime library Reference : Phi-3 Cookbook - Intel NPU acceleration library

Describe the solution you'd like

Hence, NPU engine can be added to this repo

Additional context

Update in:

  • modelui.py
  • engine.py
  • setup.py
  • README.md

Add:

  • npu_egnine.py
  • requirements-npu.txt
  • npu_models.md

szeyu avatar Sep 03 '24 06:09 szeyu