rust-punkt

rust-punkt copied to clipboard

Transferring crate?

4

Hello! I would be happy to take over this crate, certainly long enough to see it into a better place. Mostly, I would like to clean up its dependency tree...

workingjubilee

Rust-punkt and NLTK Punkt (with aligning off) produce different results when using exactly the same model. NLTK Punkt correctly identifies abbreviations and doesn't split on them, while rust-punkt, with the...

Scarfmonster

It seems, like somewhere length of string defines not correctly. Code to reproduce: ```rust use punkt::*; use punkt::params::*; fn main() { let content = "Функция. Речи."; let trainer: Trainer =...

kfreiman

How should one go about adding training data for other languages? What is the JSON data structure?

zbrox

Training data should come as separate libraries

1

Right now, the training data all comes as a single package. It might be better to include it as compiled code that is generated from a JSON document.

ferristseng

NLTK has a way to realign sentences ending with characters such as ), }, ], ", etc...

ferristseng