[FEATURE REQUEST] Add support for NPUs?

Open Iternal-JBH4 opened this issue 1 year ago • 2 comments

As NPUs are becoming more common we see a big opportunity to make the WebLLM solution more easily accessible to mass audiences if support for the NPU is added via WebNN.

Would be curious to get some insight into the status of this effort and if it is on the roadmap.

Thank you!

Oct 12 '24 16:10 Iternal-JBH4

and many linux computer cannot use webgpu in browsers,hope author can add cpu support

Oct 16 '24 15:10 maru7777

hi, any update on this?

Jan 16 '25 11:01 gopi-suvanam