SHIQ icon indicating copy to clipboard operation
SHIQ copied to clipboard

No evaluation code

Open nachifur opened this issue 2 years ago • 3 comments

The standard evaluation code is of extraordinary significance to the community. Can you provide evaluation codes for the following indicators? Looking forward to your reply. image

nachifur avatar Dec 14 '21 09:12 nachifur

For SSIM and PSNR computation, we used Matlab built-in psnr and ssim functions (for example psnr(image1, image 2) and ssim(image1, image2). You can also refer to here https://ww2.mathworks.cn/matlabcentral/fileexchange/64151-structure-similarity-ssim-and-psnr?s_tid=FX_rc2_behav.

fu123456 avatar Dec 16 '21 12:12 fu123456

For accuracy and BER computation, please refer to some shadow detection works such as https://github.com/xw-hu/CUHK-Shadow#cuhk-shadow-evaluation

fu123456 avatar Dec 16 '21 12:12 fu123456

Thank you very much for your reply. In SHIQ dataset, are the PSNR=34.13 and SSIM=0.86 in your paper calculated as follows?

for i = 1 : img_num
    i
    
    image1 = imread([testfnlist_gt{i}]);
    image2  = imread([testfnlist{i}]);
    
    psnr_ = getPSNR(image1,image2);
    ssim_ = getMSSIM(image1,image2);
    
    psnr_list(i,1) = psnr_;
    ssim_list(i,1) = ssim_;
end

psnr_mean = mean(psnr_list);
ssim_mean = mean(ssim_list);

image

For SSIM and PSNR computation, we used Matlab built-in psnr and ssim functions (for example psnr(image1, image 2) and ssim(image1, image2). You can also refer to here https://ww2.mathworks.cn/matlabcentral/fileexchange/64151-structure-similarity-ssim-and-psnr?s_tid=FX_rc2_behav.

nachifur avatar Dec 17 '21 09:12 nachifur