tokenization topic

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

adbar

Simple and customizable text tokenization gem.

thisiscetin

💫 Industrial-strength Natural Language Processing (NLP) in Python

explosion

Secure SDK/vault for personal records/PII built to comply with GDPR

securitybunker

👑 spaCy building blocks and visualizers for Streamlit apps

explosion

LunaSec - Dependency Security Scanner that automatically notifies you about vulnerabilities like Log4Shell or node-ipc in your Pull Requests and Builds. Protect yourself in 30 seconds with the LunaTra...

lunasec-io

ClangKit provides an Objective-C frontend to LibClang. Source tokenization, diagnostics and fix-its are actually implemented.

macmade

Sudachi in Rust 🦀 and new generation of SudachiPy

WorksApplications

Ravencoin Core integration/staging tree

RavenProject

CodeChain's official implementation in Rust.

CodeChain-io