tokeniser topic

Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to...

LanguageMachines

Tokenize2 is a plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item. You may have seen a similar type of text ent...

dragonofmercy

A fast, simple, multilingual tokenizer

jonsafari

Taiwanese Hokkien Transliterator and Tokeniser

andreihar