firefox-translations-training
firefox-translations-training copied to clipboard
OpusCleaner supports only a limited set of languages
I ran into an issue with Turkish: https://firefox-ci-tc.services.mozilla.com/tasks/Ip5AUlOmRU2hu2yP8RfS0w/runs/0/logs/public/logs/live.log
Specifically alpha_ratio
filter: https://github.com/hplt-project/OpusCleaner/blob/main/opuscleaner/filters/clean_common.py