evaluate Add the CIDEr metric?

Hi, I find the api in https://huggingface.co/metrics quite useful. I am playing around with video/image captioning task, where CIDEr is a popular metric. Do you plan to add this into the HF datasets library? Thanks.

Jul 13 '21 12:07 zuujhyt

same

Sep 27 '21 07:09 Kamino666

For reference: https://github.com/vrama91/cider

cc @sashavor

Jun 14 '22 15:06 lvwerra

Official CIDER implementation uses PTBTokenizer from Stanford CoreNLP. Unfortunately, it requires java and a .jar file with the library. What do you think could be an acceptable way to add CIDER to Evaluate?

Aug 08 '22 22:08 Guitaricet

Official CIDER implementation uses PTBTokenizer from Stanford CoreNLP. Unfortunately, it requires java and a .jar file with the library. What do you think could be an acceptable way to add CIDER to Evaluate?

We can do like NLTK library, have the users provide path to jar file.

Sep 23 '23 02:09 dinhanhx

Relevant topic. I'm working on language-vision models for low-resource languages, and it would be really helpful to have metrics like CIDEr-D, CIDEr-R, SPICE, and SPIDEr available in Evaluate 🐧🐧🐧🐧🐧🐧

Mar 25 '24 13:03 gabrielmotablima

Any progress?

Apr 21 '24 16:04 CurryYuan