zorikg

Results 1 issues of zorikg

Hi, I am using `LongformerTokenizerFast` and `char_to_token` is not working properly in case I set `is_split_into_words` to `True`. Here is a code to reproduce the issue: ``` import transformers from...