project-gameface
project-gameface copied to clipboard
google
Allow users to make custom faces
I have severe quadriplegic Cerebral Palsy and just stumbled upon this great idea. Unfortunately I am unable to do most of the facial expressions currently supported.
Are there any plans to allow creating "custom" faces? This would make this easier to use for a wide variety of disabilities.
@code0nwheels It looks like this application uses Mediapipe API, and there are many facial expressions that aren't implemented. Are you able to consistently activate any expressions from this example? Scroll down and enable video from the example. If you can activate any expressions from this example, it should be trivial to add those specific expressions for you.
@tqphan thanks. eye blinking and mouth puckering seem to work well. i'm going to try upgrading my webcam to see if it'll help pick more up.
ccing in @gavinhenderson here. The downside of a pre-trained model is that it won't work for some people -but we can potentially do some things. E.g. in http://github.com/acecentre/eyecommander - we use mediapipe and then use some algorithms to improve on the accuracy of open and shut eyes (rather than relying on the model to tell us about a blink) So.. short answer is - it will possibly take work from MediaPipe rather than relying on the pre-trained models to work for you. Its a tough - totally different project to create personal models.. But I would vote for that!
I understand that now. Maybe I'll go bug that repo :)
I was able to add the mouth pucker and eye blinking to the options @tqphan
It appears MediaPipe V2 supports "sticking tongue out" but I'm not sure how to add it.
Hey @code0nwheels , appreciate you sharing more about using custom gestures for some mouse actions. I wanted to check if improving the gesture size on any of the existing gestures, helps you in some way?
