web-llm
web-llm copied to clipboard
[FEATURE REQUEST] Add support for NPUs?
As NPUs are becoming more common we see a big opportunity to make the WebLLM solution more easily accessible to mass audiences if support for the NPU is added via WebNN.
Would be curious to get some insight into the status of this effort and if it is on the roadmap.
Thank you!
and many linux computer cannot use webgpu in browsers,hope author can add cpu support
hi, any update on this?