Open-NLLB icon indicating copy to clipboard operation
Open-NLLB copied to clipboard
verified publisher icon gordicaleksa

Choosing the LID model

Open vienneraphael opened this issue 2 years ago • 0 comments

Available models

  • avoid lid.218 (original nllb LID) -> it's CC-BY-NC
  • https://github.com/laurieburchell/open-lid-dataset -> GPL License, 201 lang
  • https://fasttext.cc/docs/en/language-identification.html -> lid.176, CC-BY-SA license, 176 lang

Additional informations

  • https://huggingface.co/hac541309/fasttext_langID_models -> models and hashes

vienneraphael avatar Sep 11 '23 10:09 vienneraphael