whatlanggo icon indicating copy to clipboard operation
whatlanggo copied to clipboard

Not detecting language in large text

Open creker opened this issue 5 years ago • 1 comments

Example https://play.golang.org/p/qupLXwVQc4m

First example is a large text in English. The library can't produce confident result - confidence is negative. Second example is a couple of sentences from the same text. The result is correct. It doesn't matter in which language the text is. After certain threshold it will always break.

I checked https://github.com/kapsteur/franco that seems to be using the same model and trigrams. It works.

creker avatar Jan 15 '20 12:01 creker

Thanks @creker. I'm looking into it

abadojack avatar Jan 18 '20 11:01 abadojack