HRN Bad results when face has bangs

As title mentioned, if the face has bangs, especially girls, the high mesh will get very bad results on forehead. However, I know you got very high mark on forehead part in REALY. Why I got this situation and Do you have some suggestions to solve this problem?

The following pictures show some examples.

Screenshot from 2023-06-28 11-58-32

Screenshot from 2023-06-28 10-49-04

Jun 28 '23 02:06 doublexxking

Do some basic image processing to remove hair

Jun 28 '23 04:06 yosun

Although I use bareheaded, the forehead is weird sometimes, as shown following Screenshot from 2023-06-28 14-43-33

Jun 28 '23 06:06 doublexxking

use some quick image processing techniques to remove the weird shine and uneven lighting in forehead

Jun 28 '23 07:06 yosun

Thanks for your reply and I will try your method. By the way, is there some parameters could be set to control the weight of changes? For example, I do not want to forehead to change so much towards the mean face.

Jun 28 '23 11:06 doublexxking

Moreover, I find the reason is not the weird shine or uneven lighting... The reason is the girl face is quite smaller than the mask. And the algorithm think the boundary of head is wrinkle as following shown. Screenshot from 2023-07-01 16-25-26

Jul 01 '23 08:07 doublexxking

it seems you got the forehead to be smooth. you can just use dlib 16 face border points to adjust the mesh for smaller faces

Jul 01 '23 10:07 yosun

I suppose the high mesh is not the results that author used to evaluate on the Realy or other benchmark. The displacement map should only effects the texture part by change the normal of the face. The geometry of the final results should only be Deep3DFace result + deformation map.

The high mesh is just an addition toy output of the HRN, as mentioned in #6 . If I was wrong, pls let me know. :)

Sep 21 '23 08:09 kizum