byte-pair-tokenizer topic
List
byte-pair-tokenizer repositories
rs-bpe
25
Stars
1
Forks
25
Watchers
A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust
