firefox-translations-training icon indicating copy to clipboard operation
firefox-translations-training copied to clipboard

Published 20 hours ago • verified publisher icon mozilla

Bump bicleaner-ai dependency

Open marco-c opened this issue 1 year ago • 1 comments

We are still using 2.0 (https://github.com/mozilla/firefox-translations-training/blob/71013bcea0e4647d04d508daf45fe2a96c27ef0d/pipeline/bicleaner/requirements/bicleaner-ai.in), but the latest version is 2.3.2.

2.2.0 adds support for tokenizing by characters (for Chinese).

marco-c avatar Jan 22 '24 10:01 marco-c

The full models are now stored on HuggingFace though, so not available anymore through https://github.com/bitextor/bicleaner-ai-data/releases.

marco-c avatar Jan 22 '24 10:01 marco-c

We should update to 3.0, so closing in favour of #528. Also, we're already using the models from HF.

eu9ene avatar May 08 '24 23:05 eu9ene