Camera2Vision icon indicating copy to clipboard operation
Camera2Vision copied to clipboard

Face detection stops when I tilt my head too much

Open Mokkakopf opened this issue 7 years ago • 2 comments

When I tilt my head around the z axis (eulerZ increases, while eulerY is the same), then the face recognition stops the markers are not drawn on my face anymore. This happens with an angle of 45 degrees. Any Idea why that is happening? I'm wondering, because my face is still fully visible.

Mokkakopf avatar Apr 25 '18 12:04 Mokkakopf

I completely understand your point. The reason is easy: The data used to train the face detector model does not contain enough information to detect upside-down faces. I mean, there are no rotated faces further than 45 degrees in the source data. A simple hack would be to run the detector again on the same picture/frame but upside-down (rotated 180 deg) also you will need to transpose the landmarks coordinates by (Y=Y*-1). I must say that running the detector on twice the images will probably overheat the processor, froze the app, or drop the frames you can process half. The most appropriate solution would be to train the model from scratch with double the images but upside-down.

EzequielAdrianM avatar Apr 25 '18 20:04 EzequielAdrianM

Oh, I was not aware of that, but thank you very much for your feedback!

Mokkakopf avatar Apr 26 '18 09:04 Mokkakopf