Cannot reproduce image2text score on coco dataset (CIDEr)

[byeongGuks]

Thanks for your work.

I try to reproduce paper's CIDEr score, but it failed with a difference. I hope you share the original recipe of inference on coco dataset (I2T)

@yqy2001 @Quan-Sun

[yqy2001]

We have released the evaluation code and provide an example for COCO inference. Please check it out.

Thank you for your interest in our work.

[zheedong]

Hello, I checked the evaluation code you uploaded. I reproduced the COCO 2014 Karpathy test with Emu-I's weight, and I got 77, which is less than the 117.7 you previously said. Is there anything I missed?

[yqy2001]

Hello, did you use the lateset code? I updated the evaluation prompt of COCO caption in the latest commit.

Thank you.