coco-caption icon indicating copy to clipboard operation
coco-caption copied to clipboard

Add support for all Meteor languages

Open elliottd opened this issue 8 years ago • 1 comments

The evalaution toolkit only supports Meteor evaluation in English but image description is now being studied in non-English languages German, German again, Chinese, Japanese, and Turkish.

Would it be possible to extend Meteor support for other languages? I imagine this would involve two changes:

  • [ ] Replace the bundled version of Meteor with a bash script download of the entire package
  • [ ] Add a --language option to the evaluation script (default=en)

elliottd avatar Dec 13 '16 13:12 elliottd

We are doing this in nmtpy btw: we download all paraphrase files with a script and pass -l <lang> to our coco evaluation script.

ozancaglayan avatar Oct 29 '17 12:10 ozancaglayan