tokenize topic
bkash-pgwclient-demo-flutter
bKash payment gateway integration in flutter
kor-text-preprocess
Korean text data preprocess toolkit for NLP
tokenize-comment
Uses snapdragon to tokenize a single JavaScript block comment into an object, with description, tags, and code example sections that can be passed to any other comment parsers for further parsing.
extract-comments
Extract JavaScript code comments from a string or glob of files.
tokenmonster
Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript
deid-examples
Examples scripts that showcase how to use Private AI Text to de-identify, redact, hash, tokenize, mask and synthesize PII in text.
babel-extract-comments
Uses babel to extract JavaScript code comments from a string. Returns an array of comment objects, with line, column, index, comment type and comment string.