3DMPPE_POSENET_RELEASE icon indicating copy to clipboard operation
3DMPPE_POSENET_RELEASE copied to clipboard

other public datasets,overfitting issue

Open YHaooo-4508 opened this issue 1 year ago • 6 comments

Hello, I am trying to adapt the MPII_3DHP dataset on your code, but it's totally overfitting First I train it on H36M+MPII,the MPJPE is about 50+. This is normal Then i change the dataset using MPII_3DHP+MPII to train. 50MPJPE in trainset but 200+ in validate dataset. Have you conducted experiments on MPII_3DHP dataset? Why is there such a serious overfitting?

YHaooo-4508 avatar Aug 02 '23 03:08 YHaooo-4508

I'm not clear about your experiments.

  1. First I train it on H36M+MPII,the MPJPE is about 50+. This is normal -> what is the test set?
  2. Then i change the dataset using MPII_3DHP+MPII to train. 50MPJPE in trainset but 200+ in validate dataset. -> what are the training and validation sets?

mks0601 avatar Aug 02 '23 21:08 mks0601

I'm not clear about your experiments.

  1. First I train it on H36M+MPII,the MPJPE is about 50+. This is normal -> what is the test set?
  2. Then i change the dataset using MPII_3DHP+MPII to train. 50MPJPE in trainset but 200+ in validate dataset. -> what are the training and validation sets?

1、train with H36M + MPII2D train dataset;test with H36M validate dataset 2、train with MPII_3DHP+MPII2D train dataset;test with MPII_3DHP validate dataset

YHaooo-4508 avatar Aug 03 '23 01:08 YHaooo-4508

I don't think this is from overfitting. I guess there is something wrong in your evaluation code?

mks0601 avatar Aug 03 '23 23:08 mks0601

I don't think this is from overfitting. I guess there is something wrong in your evaluation code?

I checked the code and found that there was an issue with bbox, which has been fixed. However, the results of subsequent testing were still overfitting. The validation set MPJPE was around 150, trainset is about 60. Here are some of my visualization results. Some samples also have poor results image image image image

YHaooo-4508 avatar Aug 04 '23 01:08 YHaooo-4508

Error 60 on training set means definitely underfitting

mks0601 avatar Aug 04 '23 02:08 mks0601

Error 60 on training set means definitely underfitting

Firstly, thank you for communicating with me. I know that continuing training may improve performance in the training set, but at this point, the validation set error no longer decreases, so I stopped training, and there was a significant difference between the validation set error and the training set error. By the way, during my training and validation process, I did not use object detection algorithms to predict bbox, but instead used key point positions to fit the bounding box. I am not sure if this method will affect the training.

YHaooo-4508 avatar Aug 04 '23 02:08 YHaooo-4508