mtcnn icon indicating copy to clipboard operation
mtcnn copied to clipboard

facial landmark regression

Open Rainy000 opened this issue 7 years ago • 39 comments

Hello@Seanlinx,According to issue I finished facial landmark based on your Onet, the location results is not very robust. It looks very well on some picture but sometimes the deviation is big. How to adjust the super parameters to optimize the result? PS: I already try some methods such as : learning rate(adjust to 0.001)/dropout(0.25)、weight decay(more bigger)..

Rainy000 avatar May 22 '17 03:05 Rainy000

@Rainy000 Try clip_gradient while initializing optimizer in train.py

Seanlinx avatar May 22 '17 04:05 Seanlinx

@Seanlinx I will try it, thank you very much!

Rainy000 avatar May 22 '17 04:05 Rainy000

@Rainy000 Sorry, I mistook deviation for derivative, so clip gradient is not a solution. Did you follow the ratio the author mentioned in the paper? I think raising the importance of landmark alignment task will probably help.

Seanlinx avatar May 22 '17 11:05 Seanlinx

@Seanlinx Of course, but I just do face alignment on Onet, and the ratio of tasks is: face detection : 1、box regression: 0.5、facial landmark: 1. The paper do face alignment in three phases(Pnet Rnet Onet), but I do not know how to transfer the location results of Pnet and Rnet to Onet. Can you give me some suggestions?

Rainy000 avatar May 23 '17 01:05 Rainy000

@Rainy000 You can test the celebA dataset using your Rnet model and compute normalized error of predicted landmarks, then choose those with big deviations to be the training set of Onet

Seanlinx avatar May 23 '17 03:05 Seanlinx

@Seanlinx It is similar to the hard examples of face detection training set?

Rainy000 avatar May 23 '17 06:05 Rainy000

@Rainy000 Exactly.

Seanlinx avatar May 23 '17 07:05 Seanlinx

@Rainy000,

I want to fine tune the landmark also. Some times MTCNN bad in predict the landmark point in suppose 90 degree rotation face. Can you give me step by step how to do it. Thanks

pribadihcr avatar Aug 15 '17 06:08 pribadihcr

@pribadihcr I have not tested the landmark result on 90 degree rotation face. If you want to train the landmark model, you can refer to https://github.com/Seanlinx/mtcnn/issues/25

Rainy000 avatar Aug 15 '17 08:08 Rainy000

@Rainy000 Can you share your implementation?

HaoLiuHust avatar Nov 30 '17 09:11 HaoLiuHust

@HaoLiuHust Of course. I just implement the facial landmark based on the codes of @Seanlinx , if you are interested in this , I will take some time to look for this project. And how to give you?

Rainy000 avatar Dec 01 '17 07:12 Rainy000

@Rainy000 Appreciate your help, you can give me a link or send to my email: [email protected] , thank you again

HaoLiuHust avatar Dec 01 '17 08:12 HaoLiuHust

@HaoLiuHust I have sent the codes package to your email , if you have some questions, we can discuss together, good luck~

Rainy000 avatar Dec 04 '17 06:12 Rainy000

@Rainy000 Thank you very much, but seems I did not receive the email, could you have a look?

HaoLiuHust avatar Dec 05 '17 14:12 HaoLiuHust

@Rainy000 Sorry, found it

HaoLiuHust avatar Dec 05 '17 14:12 HaoLiuHust

Dear Rainy000, @Rainy000

Could you please send me your code, i train a model base on Seanlinx's code, And i also need add face landmark detection. Please send me and let's discuss it. my email: [email protected]

thank you very much! ^_^

xiaoxiongli avatar Dec 26 '17 07:12 xiaoxiongli

@xiaoxiongli Sorry, just see your message. My company does not have network, I will send you when I go home~

Rainy000 avatar Dec 28 '17 03:12 Rainy000

@Rainy000 it is very kind of you~ thank you

xiaoxiongli avatar Dec 28 '17 10:12 xiaoxiongli

hi @Rainy000, could you please send me a copy of face landmark detection? Many thanks!

linsonwang avatar Jan 28 '18 09:01 linsonwang

@linsonwang give me your email~

Rainy000 avatar Jan 30 '18 06:01 Rainy000

@Rainy000 hi Rainy000, could you please send me a copy of facial landmark detection? My email: [email protected]. Thanks in advance!

Mumu16 avatar Feb 06 '18 03:02 Mumu16

As your code is popular, i think you can share you code on the github.

zzzzzz0407 avatar Feb 06 '18 12:02 zzzzzz0407

@Rainy000 hi Rainy000, could you please send me a copy of facial landmark detection? My email:[email protected]

KiXiang avatar Feb 08 '18 01:02 KiXiang

@KiXiang @Mumu16 OK, GOOD LUCK~

Rainy000 avatar Feb 08 '18 03:02 Rainy000

@zHanami Good ideas, but I am not familiar with how to upload code. The most important key is that the code is implemented based on @Seanlinx , so it's not good if I upload to my account.

Rainy000 avatar Feb 08 '18 03:02 Rainy000

@Rainy000 hello Rainy000,I get stuck on Landmarks, could you please send me a copy of facial landmark detection? Thanks a lot,email:[email protected]

mrgjbd avatar Mar 05 '18 03:03 mrgjbd

@Rainy000 Hi Rainy000! recently, I rewrite MTCNN by TensorFlow, but the Landmark predict is not precise, can you share your code with me, Thanks very much! email : [email protected]

OceanWong1991 avatar May 30 '18 09:05 OceanWong1991

@OceanWong1991 Sorry, I quit from last company and have not backup copy of this project. You can ask for help to upstairs user, or implement it refer to issue #25.

Rainy000 avatar May 31 '18 03:05 Rainy000

@Rainy000 can you share your code for training landmark with me ? thanks ! email :[email protected]

tzhang2014 avatar Jun 21 '18 13:06 tzhang2014

@Rainy000 can you share your code for training landmark with me ? thanks ! email :[email protected]

Fei-dong avatar Jun 22 '18 08:06 Fei-dong