DaNet-DensePose2SMPL icon indicating copy to clipboard operation
DaNet-DensePose2SMPL copied to clipboard

Question about female/neutral model

Open EnricoBeltramo opened this issue 4 years ago • 1 comments

Really a great work! I have some issue if I try to use a model different from SMPL male model. If I place female or neutral model, the reconstruction doesn't match with original image. I attach the example of a female pic with different result here the image: testwomanresize

Here with male model (good): testwomanresize_result_malemodel

here with female model: testwomanresize_result_femalemodel

here with neutral model: testwomanresize_result_neutralmodel

Is it only an issue of visualization of the model shall be trained with different models?

Thanks,

EnricoBeltramo avatar Mar 16 '20 20:03 EnricoBeltramo

Hi EnricoBeltramo, thanks for your interest in our work! The provided checkpoint file is trained with the male SMPL model, so the reconstruction results may be less satisfactory when different SMPL models are used for testing. To cope with this issue, we need to train the network with both male and female models under additional supervision of gender labels. Simply using the neutral model may not help since we found that many results appear to be feminine in this case.

HongwenZhang avatar Mar 24 '20 09:03 HongwenZhang