firefox-translations-training Dig deeper in sentences we translate badly to try and identify common failure themes

Dig deeper in sentences we translate badly to try and identify common failure themes

Open marco-c opened this issue 1 year ago • 2 comments

For example, by using tools such as compare-mt, or by comparing translations with a “good” known one and sorting by BLEU/COMET.

Oct 23 '23 21:10 marco-c

Another interesting tool in this space: https://github.com/ondrejklejch/MT-ComparEval.

Nov 09 '23 09:11 marco-c

We can also use the new eXplainable COMET models for this.

Jan 17 '24 17:01 marco-c

We could also use the same tools to compare teacher vs student and see if there are common cases where the student fails and the teacher succeeds.

Jul 26 '24 19:07 marco-c