segment

segment copied to clipboard

Accurate version of the iterator returns results which differs from ultimate/fast on a very short texts

26

Hi Jarek! I'm currently working on the project called [choppa](https://github.com/lang-uk/choppa) which is a partial python port of your great library. My intention is to bring sentence tokenization found in LanguageTool...

dchaplinsky

Use inheritance to chose the default algorithm if possible.

loomchild

loomchild

Create simple segmentation example based on Unicode Text Segmentation Algorithm: ​http://unicode.org/reports/tr29/#Sentence_Boundaries

loomchild

This will avoid wasting memory when splitting is finished and we don't need to worry about garbage collecting them manually.

loomchild