Anna Shvets

Results 3 comments of Anna Shvets

As proposed in a similar issue [https://github.com/huggingface/transformers/issues/7806](url), upgrade tokenizers. For Colab this worked for me: `%pip install --upgrade tokenizers`

Thank you for this information, it indeed helped and now I have comparable results on my side as well!

It means that the library is not installed in your environment. The link to the raw python script is a library itself - you might copy it to a python...