How to calculate the OPOPE score?

Open zhaoshitian opened this issue 1 year ago • 1 comments

May 13 '24 05:05 zhaoshitian

Hi, thanks for your interest in HALC! We have unified the evaluation in eval/batch_eval.py script. You can simply run it via: python eval/batch_eval.py -c [PATH_TO_CAPTION_FOLDER_DIR] --evaluator pope --pope_type [random/popular/adversarial] You can check the detailed calculation in eval/opope_eval.py. Please let me know if there's further questions! Thanks:)

May 14 '24 15:05 BillChan226