Manuel Romero

Combining word boxes into lines or paragraphs

7

Is there anyway (maybe any built-in function) to detect EOL chars in a large text? Or, maybe it must be done by the client by comparing the words position vector....

Add Colab notebooks with examples

2

### 🚀 The feature, motivation, and pitch How would you see if I create a couple of Colabs with the examples provided? ### Alternatives _No response_ ### Additional context _No...

### Model description [XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models](https://arxiv.org/abs/2301.10472) Large multilingual language models typically rely on a single vocabulary shared across 100+ languages. As these models...

scipy.misc.imsave has been deprecated in newer Scipy versions.

Add tokenizer to Trainer object

1

This way, It will be pushed too on trainer.push_to_hub()

Create an interactive Colab Notebook

9

I would like to contribute to this project making some Colab Notebooks showing the algorithm in action. I have seen you have a ```demo``` folder with some examples but some...