PPT icon indicating copy to clipboard operation
PPT copied to clipboard

High MPJPE value on s9 subject after 20 epochs.

Open Louis-w1214 opened this issue 3 years ago • 3 comments

Thank you for you work! I have used your code for training 20 epochs and found bad performance (high MPJPE value, over 150mm) on s9 subject but good performance on s11 subject, so what could be the reason?

Louis-w1214 avatar Oct 23 '22 14:10 Louis-w1214

Hi, Thanks for your interest in our work! I uploaded our trained model to Google Drive, here is the link. You can also see the evaluation results log inside the folder. I would suggest you evaluate this model first. If you still meet the same issue, there may be some issues with your dataset, as it is a little strange to have a good performance on one subject but a terrible performance on the other.

HowieMa avatar Oct 26 '22 23:10 HowieMa

Another possibility is that there are some issues with S9, as mentioned in https://arxiv.org/pdf/1905.05754.pdf image. Thus, I am not sure if you preprocess these data correctly.

We follow the default setting in Epipolar Transformer and remove these damaged images as well, you can see this code for more detail.

HowieMa avatar Oct 27 '22 00:10 HowieMa

Thank you for your commond, I have fixed this problem! Additionly, I noticed that in the multi-view pretrained coco model(ppt_s_ratio_07_coco_256_256.pth), the resolution is 256x256 which is different form the resolution in single-view model. I wonder what you have done to resize the figure from 256x192 resolution to 256x256. I would appreciate it if you can release the code of pretraining the model on the 256x256 coco dataset.

Louis-w1214 avatar Oct 31 '22 09:10 Louis-w1214