Inter-human score

[Yudezhi]

I can not find the code to calculate the Inter-human score. I use "kendalltau" provided by "scipy.stats" to get the mean value(0.739) of AB and AC which is not matched with yours. (ABC is assumed as three scorers in Flickr8k) However, if I keep 2 decimal places, the result is 0.73 which matched with the metric "SPICE". Wish for your reply~

[qiantianwen]

I can not find the code to calculate the Inter-human score. I use "kendalltau" provided by "scipy.stats" to get the mean value(0.739) of AB and AC which is not matched with yours. (ABC is assumed as three scorers in Flickr8k) However, if I keep 2 decimal places, the result is 0.73 which matched with the metric "SPICE". Wish for your reply~

I have the same question. Have you solved this problem?

[Yudezhi]

I can not find the code to calculate the Inter-human score. I use "kendalltau" provided by "scipy.stats" to get the mean value(0.739) of AB and AC which is not matched with yours. (ABC is assumed as three scorers in Flickr8k) However, if I keep 2 decimal places, the result is 0.73 which matched with the metric "SPICE". Wish for your reply~

I have the same question. Have you solved this problem?

嗯,最后解决了. 论文中给出的结果是正确的,印象中好像是计算三个人之间的,也就是计算三次.时间太长了,具体代码忘记了.