English tokenizer should expand contractions, e.g. `they're` to `they are` (instead of `they` and `re`)

Open niftylettuce opened this issue 5 years ago • 2 comments

e.g. https://github.com/anton-bot/expand-contractions

May 04 '20 10:05 niftylettuce

Note that we're in the process of rewriting expand-contractions into an independent package called @spamscanner/expand-contractions which has all vulnerabilities fixed and also a modern updated of contractions (see https://github.com/anton-bot/expand-contractions/pull/1).

Jun 12 '22 20:06 titanism

Ref: https://github.com/stdlib-js/stdlib/issues/496

Jun 13 '22 05:06 titanism