Alexandre Caulier
Alexandre Caulier
For FST-based tokenizer, I re-implemented the c++ library OpenFST in full Rust : https://github.com/Garvys/rustfst (And it has better performances than OpenFST 😅 ) Might prove usefull. In the OpenFST doc,...
Nice ! 👍