DeepFaceLab icon indicating copy to clipboard operation
DeepFaceLab copied to clipboard

Weird face shapes in XSeg trainer

Open czyzpkk opened this issue 2 years ago • 3 comments

Expected behavior

See normal faces as i labeled them.

Actual behavior

XSeg trainer looks like this: (This is from the default Elon Musk video by the way) Screenshot (1491)

Steps to reproduce

I deleted the labels, then labeled again.

Other relevant information

OS : Windows 10 Home - OS Build: 19044.1949 Python version: 3.10

czyzpkk avatar Sep 12 '22 12:09 czyzpkk

That just looks like "Random Warp". Its a method of randomly warping the image as it trains so it is better at generalization. This is fairly expected behavior to make training more robust, unless it is incorrectly masking your faces after it has been trained and applied to merged faces. This is not a problem unless this translates to the final image that gets rendered out. If it is doing this to the merged faces then just turn off random warping in the model parameters and train for a bit longer.

CodeSmith2000 avatar Sep 22 '22 18:09 CodeSmith2000

Thank you for your answer. How can i turn off random warping? I looked it up on the internet but cant find anthing.

czyzpkk avatar Sep 24 '22 13:09 czyzpkk

I'm not sure if you can turn off random warping for XSeg training and frankly I don't thing you should, it helps to make the mask training be able to generalize on new data sets.

CodeSmith2000 avatar Sep 25 '22 01:09 CodeSmith2000

Did you ever find the answer? If so, would you mind sharing it and closing this issue?

joolstorrentecalo avatar Jun 08 '23 23:06 joolstorrentecalo