embeddedllm icon indicating copy to clipboard operation
embeddedllm copied to clipboard
Published 1 year ago • verified publisher icon EmbeddedLLM

Add NPU Engine

Open szeyu opened this issue 1 year ago • 3 comments

Add NPU Engine #28

Reference : Phi-3 Cookbook - Intel NPU acceleration library

image

Update in:

  • modelui.py
  • engine.py
  • setup.py
  • README.md

Add:

  • npu_egnine.py
  • requirements-npu.txt
  • npu_models.md

szeyu avatar Sep 05 '24 02:09 szeyu

@szeyu The NPU support looks good. I added some reviews. If those are resolved then it should be go to be merged.

Before merging this PR, can you first merged the OpenVINO vison model PR then only merge this NPU Engine?

tjtanaa avatar Sep 25 '24 21:09 tjtanaa

@szeyu can you also resolve the conflicts?

tjtanaa avatar Oct 06 '24 04:10 tjtanaa

@szeyu can you also resolve the conflicts?

resolved conflict

szeyu avatar Oct 06 '24 10:10 szeyu