AHIQ icon indicating copy to clipboard operation
AHIQ copied to clipboard

How to interpret score values?

Open Ellyuca opened this issue 2 years ago • 1 comments

Hi. Thanks for this interesting work.

I want to use this full reference metric to evaluate the quality of some images for my research.

I managed to run the code and I tried a few images from the PIPAL validation set (i.e the image of the parrot A0019.bmp and the image with a house A0020.bmp and their corresponding distorted versions A0019_10_04.bmp and A0020_10_04.bmp). I used this model: AHIQ_vit_p8_epoch33.pth.

When I compare A0019_10_04.bmp with A0019.bmp I get as score 0.466813. For A0020_10_04.bmp with A0020.bmp I get 0.589722. But then when I compare the images with themselves (A0019.bmp with A0019.bmp and A0020.bmp with A0020.bmp) I get the scores 0.691261 and 0.704291, respectively.

I am wondering that is the score range min and max value for this metric? It is 0 and 1? How do you interpret the score values? Lower means more different? Higher means more similar? For examples, in the case of other FR metrics like SSIM, when I compare two identical images I get a score of 1, so then I can say that the images are identical. But with your metric, how can I tell if 2 images are the same (or different) just by looking at the score values?

Thank you for your time. I'm looking forward to your answer. Have a great day!

Ellyuca avatar Sep 28 '22 17:09 Ellyuca

Same as above.

yangyijune avatar Nov 22 '22 08:11 yangyijune