DifFace icon indicating copy to clipboard operation
DifFace copied to clipboard

Could you release your metric calculation script please?

Open HWalkingMan opened this issue 2 years ago • 2 comments

Your work is awesome! I have tested with your pre-trained model on CelebaTest and got amazing visual results.

However, I noticed that your paper and the VQFR's paper both provide metrics for testing VQFR on CelebaTest, and these metrics are different.

Thus, I used your model to infer on the CelebaTest dataset provided by VQFR link here and use the calculation script provided by VQFR link here, the unexpected results were obtained.

Therefore, I am very curious about the quantitative metrics mentioned in the paper. How do you calculate the metrics? Could you release your metric calculation script please?

HWalkingMan avatar Jan 12 '23 12:01 HWalkingMan

For PSNR and LPIPS: https://github.com/chaofengc/IQA-PyTorch

For LPIPS (VGG): https://github.com/richzhang/PerceptualSimilarity

For IDS: see the script of VQFR.

For FID: https://github.com/mseitzer/pytorch-fid

As for as I know, for the metric of FID, VQFR and GFPGAN are calculated between the restored faces and the whole faces in FFHQ. However, in our paper, it is directly calculated between the restored faces and the corresponding ground truth.

zsyOAOA avatar Jan 12 '23 13:01 zsyOAOA

Thanks for your scripts~

HWalkingMan avatar Jan 30 '23 10:01 HWalkingMan