AGIQA-3k-Database icon indicating copy to clipboard operation
AGIQA-3k-Database copied to clipboard

About alignment metric

Open XiaoqiWang opened this issue 1 year ago • 2 comments

I would like to confirm whether the paper evaluates the alignment metric by calculating the score for all samples, or 80% for training and 20% for testing.

XiaoqiWang avatar Sep 11 '23 12:09 XiaoqiWang

Hi. Alignment is the score for all samples

lcysyzxdxc avatar Oct 10 '23 15:10 lcysyzxdxc

谢谢你的回复,我想再确认一下:论文表3(a)中,作者使用一些预训练模型例如CLIP,直接测试数据集中所有样本关于图文对齐的性能,没有finetuning?如果是这样,我测试出来的结果和表3(a)的差距很大,例如ImageReward 的SRCC只有0.4765,而作者的是0.7298. 在图文对齐测试中,论文并未对数据划分方式进行说明。

XiaoqiWang avatar Nov 04 '23 03:11 XiaoqiWang