nlp-discussion icon indicating copy to clipboard operation
nlp-discussion copied to clipboard

Existing work: Language identification

Open danieldk opened this issue 6 years ago • 2 comments

danieldk avatar May 08 '19 08:05 danieldk

Natural language detection for Rust with focus on simplicity and performance: whatlang-rs has been in development for 3 years; I've not used it but it looks solid.

jbowles avatar May 09 '19 14:05 jbowles

Indeed looks like a solid option that supports a lot of languages. Note though that the Cavnar & Trenkle has been succeeded by more modern and accurate techniques, see e.g.:

https://fasttext.cc/blog/2017/10/02/blog-post.html

danieldk avatar May 09 '19 15:05 danieldk