Deep3DFaceReconstruction icon indicating copy to clipboard operation
Deep3DFaceReconstruction copied to clipboard

Training Process Problems

Open zomkey opened this issue 5 years ago • 12 comments

Hi,thanks for your work, I am really interested ! Now I have implement training process according to your paper, but I found some problems during training:

  1. Image-level loss is hard to converge,with which the loss is about 40~50 at last , leading the reconstruction result to be mean shape without real texture of input image. (I used skin mask to train, and I want to ask whether there exists any tricks to converge Image-level loss ?)
  2. Land-mark loss and image-level loss is hard to balance, which means that if I increase the weight of Land-mark loss, which will lead reconstruction result to have accurate pose and expression but wrong face color. On the contrast, if the weight of image-level loss is increased, the reconstruction result can have accurate face color but wrong pose and expression. (I want to ask How to balance this two losses?)
  3. The learning rate is also important during training, which Learning rate strategy is used to achieve good results ? Hope for your advice, thank you very much!

zomkey avatar Nov 27 '19 13:11 zomkey

Hi, thanks for your interest in this work. For photo-level loss, we normalize the color to 0-1 for output images and as a reference, the training loss drops to 0.1 in my training process. You could also try to reduce the weight of regularization on textures. The ratio between the weighted value (loss*weight) of photo-loss and landmark-loss is around 10 in my case. We do not carefully adjust the learning rate. We only use a Adam optimize with constant learning rate throughout the experiment.

YuDeng avatar Nov 28 '19 05:11 YuDeng

Thanks for your advice, now I can achieve a convergency result.

zomkey avatar Nov 28 '19 11:11 zomkey

@zomkey Hi, I am very interested in this work too, if convenient, could you send me your training codes so that I can learn the process better? My email address is : [email protected] Thank you very much!

hangon666 avatar Nov 28 '19 14:11 hangon666

@zomkey Hello, can you share your training code with me? My email : [email protected] Thanks a lot

Light-SH avatar Dec 22 '19 07:12 Light-SH

@zomkey Hi, I am very interested in this work too, if convenient, could you send me your training codes so that I can learn the process better? My email address is : [email protected] Thank you very much!

Hi~Did you get the training codes? Recently, I am working on this project, too, so I want to know if you have got the training codes since I need that for my thesis.

Chen-Jinlong avatar Dec 27 '19 09:12 Chen-Jinlong

Thanks for your advice, now I can achieve a convergency result.

I also always get mean shape. have you solved this problem??

xingmimfl avatar May 11 '20 09:05 xingmimfl

@zomkey Hi, I am very interested in this work too, if convenient, could you send me your training codes so that I can learn the process better? My email address is : [email protected] Thank you very much!

Hi, Did you get the training code? Would you please sent it to me?

HOMGH avatar May 18 '20 19:05 HOMGH

@zomkey Wow, I am very interested in this work too, if convenient, could you send me your training codes so that I can learn the process better? My email address is :[email protected] Thank you!

ZMpursue avatar Jun 08 '20 03:06 ZMpursue

Thanks for your advice, now I can achieve a convergency result.

Hi, I am very interested in this work too, if convenient, could you send me your training codes ? Thank you very much! My email address is : [email protected]

UestcJay avatar Jul 14 '20 12:07 UestcJay

Thanks for your advice, now I can achieve a convergency result.

Hi, I am very interested in this work too, if convenient, could you send me your training codes ? Thank you very much! My email address is : [email protected]

JacksonL1 avatar Nov 04 '20 09:11 JacksonL1

Thanks for your advice, now I can achieve a convergency result.

Hi, I am very interested in this work too, if convenient, could you send me your training codes ? Thank you very much! My email address is : [email protected]

Yishun99 avatar Nov 05 '20 11:11 Yishun99

Hi, I am very interested in this work too, if convenient, could you send me your training codes ? Thank you very much! My email address is : [email protected]

mingsjtu avatar Jan 12 '21 02:01 mingsjtu

@zomkey Hi, I am very interested in this work too, if convenient, could you send me your training codes ? Thank you very much! My email address is : [email protected]

lhh753159 avatar Oct 31 '22 05:10 lhh753159