Thomas Palmeira Ferraz

Results 2 comments of Thomas Palmeira Ferraz

I need to edit a tokenizer to add a new language code, how can i do it on NllbTokenizer? On the code I'm using it is like that: ``` old_len...

> I need to edit a tokenizer to add a new language code, how can i do it on NllbTokenizer? On the code I'm using it is like that: >...