DeblurGAN icon indicating copy to clipboard operation
DeblurGAN copied to clipboard

cannot reproduce PSNR.

Open rimchang opened this issue 6 years ago • 4 comments

I use below command.

python test.py --dataroot ./ --model test --dataset_mode single --learn_residual --loadSizeX 1280 --loadSizeY 720 --resize_or_crop test

I try to test on whole GOPRO-test set, but i cannot reproduce PSNR. Could you tell me how to reproduce it?

below is evaluation result using matlab psnr and your repo's psnr

matlab psnr

GOPR0384_11_00 Video PSNR : 27.90, SSIM : 0.00, Count : 100 GOPR0384_11_05 Video PSNR : 27.04, SSIM : 0.00, Count : 100 GOPR0385_11_01 Video PSNR : 26.44, SSIM : 0.00, Count : 100 GOPR0396_11_00 Video PSNR : 28.75, SSIM : 0.00, Count : 100 GOPR0410_11_00 Video PSNR : 25.93, SSIM : 0.00, Count : 134 GOPR0854_11_00 Video PSNR : 22.95, SSIM : 0.00, Count : 100 GOPR0862_11_00 Video PSNR : 22.16, SSIM : 0.00, Count : 77 GOPR0868_11_00 Video PSNR : 22.37, SSIM : 0.00, Count : 100 GOPR0869_11_00 Video PSNR : 24.62, SSIM : 0.00, Count : 100 GOPR0871_11_00 Video PSNR : 22.73, SSIM : 0.00, Count : 100 GOPR0881_11_01 Video PSNR : 25.36, SSIM : 0.00, Count : 100 Total Video PSNR : 25.20, SSIM : 0.00, Count : 1111

this repo's psnr

GOPR0869_11_00 Video's PSNR : 24.618, SSIM : 0.000, Count : 100 GOPR0862_11_00 Video's PSNR : 22.161, SSIM : 0.000, Count : 77 GOPR0410_11_00 Video's PSNR : 25.929, SSIM : 0.000, Count : 134 GOPR0384_11_05 Video's PSNR : 27.039, SSIM : 0.000, Count : 100 GOPR0385_11_01 Video's PSNR : 26.437, SSIM : 0.000, Count : 100 GOPR0881_11_01 Video's PSNR : 25.361, SSIM : 0.000, Count : 100 GOPR0854_11_00 Video's PSNR : 22.955, SSIM : 0.000, Count : 100 GOPR0396_11_00 Video's PSNR : 28.746, SSIM : 0.000, Count : 100 GOPR0384_11_00 Video's PSNR : 27.901, SSIM : 0.000, Count : 100 GOPR0868_11_00 Video's PSNR : 22.369, SSIM : 0.000, Count : 100 GOPR0871_11_00 Video's PSNR : 22.730, SSIM : 0.000, Count : 100 Total Video's PSNR : 25.199, SSIM : 0.000, Count : 1111

rimchang avatar Sep 14 '18 17:09 rimchang

I also test half-resolution as you describe here (https://github.com/KupynOrest/DeblurGAN/issues/41#issuecomment-387051108)

I use below command and using matlab resize, psnr.

python test.py --dataroot ./ --model test --dataset_mode single --learn_residual --loadSizeX 640 --loadSizeY 360 --resize_or_crop test

but also i cannot reproduce psnr.

GOPR0384_11_00 Video PSNR : 27.51, SSIM : 0.00, Count : 100 GOPR0384_11_05 Video PSNR : 26.87, SSIM : 0.00, Count : 100 GOPR0385_11_01 Video PSNR : 27.09, SSIM : 0.00, Count : 100 GOPR0396_11_00 Video PSNR : 27.19, SSIM : 0.00, Count : 100 GOPR0410_11_00 Video PSNR : 26.02, SSIM : 0.00, Count : 134 GOPR0854_11_00 Video PSNR : 23.02, SSIM : 0.00, Count : 100 GOPR0862_11_00 Video PSNR : 22.30, SSIM : 0.00, Count : 77 GOPR0868_11_00 Video PSNR : 22.26, SSIM : 0.00, Count : 100 GOPR0869_11_00 Video PSNR : 24.56, SSIM : 0.00, Count : 100 GOPR0871_11_00 Video PSNR : 22.69, SSIM : 0.00, Count : 100 GOPR0881_11_01 Video PSNR : 25.42, SSIM : 0.00, Count : 100 Total Video PSNR : 25.08, SSIM : 0.00, Count : 1111

rimchang avatar Sep 14 '18 17:09 rimchang

I wanna know how can you get the PSNR, When I test with this command, I can only get the restored picture, but I can not get the PSNR

YRunner avatar Jul 08 '19 08:07 YRunner

PSNR = 25.523451, SSIM = 0.781016 Bad Bad Bad

laomao0 avatar Jul 18 '19 13:07 laomao0

(1280x720)psnr=24.942067 what can i do

1z1y avatar Aug 11 '23 13:08 1z1y