sentencex icon indicating copy to clipboard operation
sentencex copied to clipboard

FYI: Rust Implementation Available

Open mush42 opened this issue 1 year ago • 1 comments

Hello

FYI: I ported the code to Rust,. Rust implementation passes all the tests the current implementation passes.

https://github.com/mush42/tqsm

This unlocks a lot of speedups and use cases:

  • Moderate speedup (since REGEX engine is the bottleneck anyways)
  • True parallelism
  • The ability to compile to WASM and use from JavaScript
  • The ability to create a statically-linked command line wrapper

Currently, I have the following available in the repo:

  • Core implementation
  • Command line wrapper
  • Python bindings

Best Musharraf

mush42 avatar Jul 16 '24 21:07 mush42

Thanks a lot for this initiative. :heart:

FYI, The js port is available at https://github.com/wikimedia/sentencex-js - (I should update the docs with link to this)

What is the meaning of tqsm ? is it based on the naming of tqdm? :)

As per the performance table, it shows the same number for sentencex and tqsm - Is it so or table yet to be updated?

santhoshtr avatar Jul 17 '24 04:07 santhoshtr