sentencex
sentencex copied to clipboard
FYI: Rust Implementation Available
Hello
FYI: I ported the code to Rust,. Rust implementation passes all the tests the current implementation passes.
https://github.com/mush42/tqsm
This unlocks a lot of speedups and use cases:
- Moderate speedup (since REGEX engine is the bottleneck anyways)
- True parallelism
- The ability to compile to WASM and use from JavaScript
- The ability to create a statically-linked command line wrapper
Currently, I have the following available in the repo:
- Core implementation
- Command line wrapper
- Python bindings
Best Musharraf
Thanks a lot for this initiative. :heart:
FYI, The js port is available at https://github.com/wikimedia/sentencex-js - (I should update the docs with link to this)
What is the meaning of tqsm ? is it based on the naming of tqdm? :)
As per the performance table, it shows the same number for sentencex and tqsm - Is it so or table yet to be updated?