yoruba-text

yoruba-text copied to clipboard

scraped bbc yoruba news

1

sire-ambrose

Add https://oscar-corpus.com, common crawl from the BBC to the working corpus for ADR and other monolingual tasks ``` Language | Words original | Size original | File original | Words...

ruohoruotsi

Provide a script to cleanly download and normalize text

3

Rather than the current system of each sub-corpora it is own folder with its own code. Create a top-level `downloads.sh` which can re-assemble the sub-corpora. Separately, have the downloaded &...

ruohoruotsi

[CLEANUP] unclean text

1

Right now OCR texts (Aaro Meta, Ogboju, etc) suffer from errors intrinsic to the OCR process (non Yorùbá characters, inconsistencies from sentence to sentence that don't reflect a human's authors...

ruohoruotsi

1) Alaroye https://alaroye.tv/category/iroyin 2) https://www.bbc.com/yoruba

dadelani