langid.py icon indicating copy to clipboard operation
langid.py copied to clipboard

Published 20 hours ago • verified publisher icon saffsd

Detection error when processing full-width letters

Open joewong826 opened this issue 8 years ago • 1 comments

When processing full-width letters, it returns "Chinese" as result: >>> import langid >>> langid.classify('ＡＢＣ') ('zh', 0.9668056948707975)

joewong826 avatar Jul 08 '16 09:07 joewong826

ＡＢＣis Double-byte characters

leafiy avatar Jul 10 '16 11:07 leafiy