ImageReward icon indicating copy to clipboard operation
ImageReward copied to clipboard

Yet another question on standard deviation

Open tusharbhutt opened this issue 9 months ago • 2 comments

Hi, in this link, you mention the standard deviations:

https://github.com/THUDM/ImageReward/issues/7#issuecomment-1519305586

You seem to have a range of scores from -2 to +2 and 98.2% of the scores will fall between. What happens to the outliers? If something is in the 99.999 percentile, what is the value....? Does your range actually cover -2.1 to +2.1?

If I have an image that has an exact score of 1.0, does that mean it is exactly 1 standard deviation above the mean? So, on a bell curve, it would be 34% above the fiftieth percentile, so it would have a percentage score of 84.13? Would it be fair then to say the score out of 10 would be 8.41 for that image?

Thanks for any light you can shed on this subject.

tusharbhutt avatar Sep 25 '23 03:09 tusharbhutt