mediapipe icon indicating copy to clipboard operation
mediapipe copied to clipboard

Published 20 hours ago • verified publisher icon google-ai-edge

NPU Support

Open nskaiser opened this issue 1 year ago • 2 comments

MediaPipe Solution (you are using)

Holistic

Programming language

Javascript

Are you willing to contribute it

None

Describe the feature and the current behaviour/state

Utilize NPUs

Will this change the current API? How?

Minimally

Who will benefit with this feature?

Newer "AI Computers" from HP, Dell, etc will start featuring NPUs

Please specify the use cases for this feature

The future of GPUs is NPUs. There is a big push with all the major hardware providers and they are hitting market now. Clients have asked us if our application (which uses Mediapipe) can run on their NPUs.

Any Other info

No response

nskaiser avatar Mar 21 '24 15:03 nskaiser

Thanks for filing this - and we totally agree with you. At this moment, NPU differ greatly among platforms and as such, we cannot yet build a cross-platform framework easily. We have lots of people working on NPU support for our various projects though, so there is some hope :)

schmidt-sebastian avatar Mar 22 '24 16:03 schmidt-sebastian

Hi @schmidt-sebastian , just wondering if there have been any updates to share related to NPU support? Thanks!

nskaiser avatar Jun 24 '24 16:06 nskaiser

Hi @schmidt-sebastian . I'd like to follow up on this topic. Is NPU support available now (for Samsung NPUs in particular)?

yuliang419 avatar Jan 16 '25 15:01 yuliang419

We currently don't have NPU support for our Vision APIs. Thank you.

schmidt-sebastian avatar Jan 16 '25 15:01 schmidt-sebastian

We currently don't have NPU support for our Vision APIs. Thank you.

Is this something in the roadmap?

nskaiser avatar Jan 16 '25 16:01 nskaiser