guillaume-be

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

guillaume-be

Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models

guillaume-be

Fincausal 2020 shared task

guillaume-be

Supporting example for "A Rust SentencePiece implementation"

guillaume-be