lexical-analysis topic

List lexical-analysis repositories

jiebaR

340
Stars
110
Forks
Watchers

Chinese text segmentation with R. R语言中文分词 (文档已更新 🎉 :https://qinwenfeng.com/jiebaR/ )

libfsm

915
Stars
52
Forks
Watchers

DFA regular expression library & friends

acwj

10.0k
Stars
982
Forks
Watchers

A Compiler Writing Journey

dlib

216
Stars
32
Forks
Watchers

Allocators, I/O streams, math, geometry, image and audio processing for D

lac

3.8k
Stars
588
Forks
Watchers

百度NLP:分词,词性标注,命名实体识别,词重要性

lexer

333
Stars
21
Forks
Watchers

A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器

xmnlp

1.2k
Stars
189
Forks
Watchers

xmnlp:提供中文分词, 词性标注, 命名体识别,情感分析,文本纠错,文本转拼音,文本摘要,偏旁部首,句子表征及文本相似度计算等功能

OysterKit

178
Stars
24
Forks
Watchers

OysterKit is a framework that provides a native Swift scanning, lexical analysis, and parsing capabilities. In addition it provides a language that can be used to rapidly define the rules used by Oyst...

llvm-kaleidoscope

225
Stars
48
Forks
Watchers

LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)