DeblurGAN
DeblurGAN copied to clipboard
cannot reproduce PSNR.
I use below command.
python test.py --dataroot ./ --model test --dataset_mode single --learn_residual --loadSizeX 1280 --loadSizeY 720 --resize_or_crop test
I try to test on whole GOPRO-test set, but i cannot reproduce PSNR. Could you tell me how to reproduce it?
below is evaluation result using matlab psnr and your repo's psnr
matlab psnr
GOPR0384_11_00 Video PSNR : 27.90, SSIM : 0.00, Count : 100 GOPR0384_11_05 Video PSNR : 27.04, SSIM : 0.00, Count : 100 GOPR0385_11_01 Video PSNR : 26.44, SSIM : 0.00, Count : 100 GOPR0396_11_00 Video PSNR : 28.75, SSIM : 0.00, Count : 100 GOPR0410_11_00 Video PSNR : 25.93, SSIM : 0.00, Count : 134 GOPR0854_11_00 Video PSNR : 22.95, SSIM : 0.00, Count : 100 GOPR0862_11_00 Video PSNR : 22.16, SSIM : 0.00, Count : 77 GOPR0868_11_00 Video PSNR : 22.37, SSIM : 0.00, Count : 100 GOPR0869_11_00 Video PSNR : 24.62, SSIM : 0.00, Count : 100 GOPR0871_11_00 Video PSNR : 22.73, SSIM : 0.00, Count : 100 GOPR0881_11_01 Video PSNR : 25.36, SSIM : 0.00, Count : 100 Total Video PSNR : 25.20, SSIM : 0.00, Count : 1111
this repo's psnr
GOPR0869_11_00 Video's PSNR : 24.618, SSIM : 0.000, Count : 100 GOPR0862_11_00 Video's PSNR : 22.161, SSIM : 0.000, Count : 77 GOPR0410_11_00 Video's PSNR : 25.929, SSIM : 0.000, Count : 134 GOPR0384_11_05 Video's PSNR : 27.039, SSIM : 0.000, Count : 100 GOPR0385_11_01 Video's PSNR : 26.437, SSIM : 0.000, Count : 100 GOPR0881_11_01 Video's PSNR : 25.361, SSIM : 0.000, Count : 100 GOPR0854_11_00 Video's PSNR : 22.955, SSIM : 0.000, Count : 100 GOPR0396_11_00 Video's PSNR : 28.746, SSIM : 0.000, Count : 100 GOPR0384_11_00 Video's PSNR : 27.901, SSIM : 0.000, Count : 100 GOPR0868_11_00 Video's PSNR : 22.369, SSIM : 0.000, Count : 100 GOPR0871_11_00 Video's PSNR : 22.730, SSIM : 0.000, Count : 100 Total Video's PSNR : 25.199, SSIM : 0.000, Count : 1111
I also test half-resolution as you describe here (https://github.com/KupynOrest/DeblurGAN/issues/41#issuecomment-387051108)
I use below command and using matlab resize, psnr.
python test.py --dataroot ./ --model test --dataset_mode single --learn_residual --loadSizeX 640 --loadSizeY 360 --resize_or_crop test
but also i cannot reproduce psnr.
GOPR0384_11_00 Video PSNR : 27.51, SSIM : 0.00, Count : 100 GOPR0384_11_05 Video PSNR : 26.87, SSIM : 0.00, Count : 100 GOPR0385_11_01 Video PSNR : 27.09, SSIM : 0.00, Count : 100 GOPR0396_11_00 Video PSNR : 27.19, SSIM : 0.00, Count : 100 GOPR0410_11_00 Video PSNR : 26.02, SSIM : 0.00, Count : 134 GOPR0854_11_00 Video PSNR : 23.02, SSIM : 0.00, Count : 100 GOPR0862_11_00 Video PSNR : 22.30, SSIM : 0.00, Count : 77 GOPR0868_11_00 Video PSNR : 22.26, SSIM : 0.00, Count : 100 GOPR0869_11_00 Video PSNR : 24.56, SSIM : 0.00, Count : 100 GOPR0871_11_00 Video PSNR : 22.69, SSIM : 0.00, Count : 100 GOPR0881_11_01 Video PSNR : 25.42, SSIM : 0.00, Count : 100 Total Video PSNR : 25.08, SSIM : 0.00, Count : 1111
I wanna know how can you get the PSNR, When I test with this command, I can only get the restored picture, but I can not get the PSNR
PSNR = 25.523451, SSIM = 0.781016 Bad Bad Bad
(1280x720)psnr=24.942067 what can i do