dkpro-core icon indicating copy to clipboard operation
dkpro-core copied to clipboard

LanguageToolSegmenter chokes on "丁肇中"

Open reckart opened this issue 9 years ago • 0 comments

LanguageToolSegmenter chokes on "丁肇中":

Caused by: java.lang.IllegalStateException: Token [丁中] not found in sentence [丁肇中]
    at de.tudarmstadt.ukp.dkpro.core.languagetool.LanguageToolSegmenter.process(LanguageToolSegmenter.java:90)

reckart avatar Mar 14 '16 12:03 reckart