py3langid icon indicating copy to clipboard operation
py3langid copied to clipboard

bad case: print(identifier.classify("开会。")) , output:('ja', 0.97436696). except: ('zh', 1.0)

Open bestlee666 opened this issue 1 year ago • 1 comments

bad case:

print(identifier.classify("开会。")) ,

output:('ja', 0.97436696).

except: ('zh', 1.0)

bestlee666 avatar Nov 05 '24 01:11 bestlee666

When the input string is too short is it more difficult to guess but there is indeed an issue here, simplified Chinese characters are obviously not Japanese.

adbar avatar Nov 20 '24 16:11 adbar