tokenizer topic

Tokenization for Julia source code

JuliaLang

Simple yet helpful library for writing Django urls by an easy, short and intuitive way.

venturachrisdev

PHP standards checker.

HippoPHP

Colin's ALM Corner Custom Build Tasks

colindembovsky

A Python implementation of Farasa toolkit

MagedSaeed

Ruby Object Inspection for IRB

janlelis

集成了FTS5中文分词器的Sqlite3源码

TangXiaoLv

Essential NLP & ML, short & fast pure Python code

textgain

A collection of basic python modules for spoken natural language processing

gooofy

Tokenize CSS according to the CSS Syntax

csstools