Adrien Barbaresi

Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

adbar

Fast and robust date extraction from web pages, with Python or on the command-line

adbar

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

adbar

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

adbar

Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters

adbar

Faster, modernized fork of the language identification tool langid.py

adbar