chinese-tokenizer topic

High performance Chinese tokenizer with both GBK and UTF-8 charset support based on MMSEG algorithm developed by ANSI C. Completely based on modular implementation and can be easily embedded in other...

lionsoul2014

基于深度学习的自然语言处理库

supercoderhawk

一个微型&算法全面的中文分词引擎 | A micro tokenizer for Chinese

howl-anderson

中文分词软件基准测试 | Chinese tokenizer benchmark

howl-anderson

使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle

howl-anderson

A NLP package for Chinese text：Preprocessing, Tokenization, Chinese Fonts, Word Embeddings, Text Similarity and Sentiment Analysis 轻量级中文自然语言处理软件包

samzshi0529