icu4x icon indicating copy to clipboard operation
icu4x copied to clipboard

Published 20 hours ago • verified publisher icon unicode-org

Consider using grapheme cluster breaker in dictionary segmenter

Open makotokato opened this issue 2 years ago • 1 comments

Related to https://github.com/unicode-org/icu4x/pull/1897 and https://github.com/unicode-org/icu4x/issues/1531. After we move dictionary segmenter to DataProvider and testdata, it is better to use GraphmeSegmenter in dictionary segmenter instead.

makotokato avatar Jun 28 '22 05:06 makotokato

@makotokato Can you work on this, after the other 1.0 issues are done?

sffc avatar Jul 30 '22 03:07 sffc

Segmenter is going to remain in alpha at ICU4X 1.0 so I'm moving this to 1.1

sffc avatar Sep 26 '22 18:09 sffc