mediapipe

mediapipe copied to clipboard

According to the documentation and this issue it's possible to apply a PNGBlob 2D or 3D to a FaceMesh.

• Is there an example for Desktop / JS ?
• Android code seems to use a FaceMeshResult + GPU trick

Any simple JS Demo that apply the face pattern ?

Hi, I am also curious if you have a JS demo or documentation about face effects. I've been trying to use MediaPipe + ThreeJS to render sunglasses on the face using MediaPipe's facemesh, but I would very much like to try MediaPipe's own face effect renderer as stated in this documentation

Hi @furkandindar, Have a look at this https://github.com/google/mediapipe/issues/2673#issuecomment-946113076

We expose the 3d geometry of the face, and this can be fed directly into toolkits such as ThreeJS. We have internal demos showing face effects. I will bring this up to the team as I would love to release this to the larger community.

@mhays-google Hi there, just want you to know that we also want a face geometry web demo badly! I searched the entire Internet for this. I found some demos on TF blog but they are all broken :( Like this one: https://blog.tensorflow.org/2020/11/iris-landmark-tracking-in-browser-with-MediaPipe-and-TensorFlowJS.html

Would be awesome to have a standalone web example of FaceMesh

• with glasses
• with lipstick
• with hair segmentation

I'm working on SamrtMirror using Google Chrome only :-/ It seems PerfectCorp did something like that in the browser with MediaPipe

Can we expect the same for python version?

Hey everyone,

Any updates on this or any expected time frame?

Thanks!

Hey! some new here? I want to put my face over my face!

@mhays-google Hi, do you have plans to release the demos yet?

Little push up, A demo of Face Overlay for the web would be awesome

• To add Glasses, Hat, ...
• To update makeup (color overlay)

There is more and more startups working on that kind of usecase. A little for the web would kickstart everyone ;-)

You might find this helpful: https://hiukim.github.io/mind-ar-js-doc/more-examples/threejs-face-facemesh/

We expose the 3d geometry of the face, and this can be fed directly into toolkits such as ThreeJS. We have internal demos showing face effects. I will bring this up to the team as I would love to release this to the larger community.

@mhays-google Any hope about showing some demos for face effect API ?

:)) Add me to waiters list. Is there any news about the face ffect demos?

Hello @JpEncausse, We are upgrading the MediaPipe Legacy Solutions to new MediaPipe solutions However, the libraries, documentation, and source code for all the MediaPipe Legacy Solutions will continue to be available in our GitHub repository and through library distribution services, such as Maven and NPM.

You can continue to use those legacy solutions in your applications if you choose. Though, we would request you to check new MediaPipe solutions which can help you more easily build and customize ML solutions for your applications. These new solutions will provide a superset of capabilities available in the legacy solutions.

@kuaashish the new MediaPipe solution is very promising, I like the HandTracking demo ! But there is no mention to Face Landmarks :-( there is so much usecase on JS/Web:

• Face Augmented Reality for Beauty and Skin Care or Glasses
• Reading Lips
• Eye Tracking

Any plan to add them to the demos ? It is one of the key features Google/MediaPipe have compared to Microsoft that will no longer provide Face Description ...

Hi @schmidt-sebastian, We have any plans to include this in our new mediapipe solutions?

https://www.npmjs.com/package/@mediapipe/tasks-vision alpha 11 and higher include FaceLandmarker.