tantivy icon indicating copy to clipboard operation
tantivy copied to clipboard

Published 20 hours ago • verified publisher icon quickwit-oss

Persian [Farsi] language support

Open Hadryan opened this issue 2 years ago • 1 comments

There are approximately 110 million Persian speakers worldwide, including Persians, Tajiks, Hazaras, Caucasian Tats and Aimaqs. (Wikipedia)

Thanks for this great project, that would be great if there will be support for that.

Hadryan avatar Jul 16 '22 11:07 Hadryan

See my reply on #1417, this is out of tantivy's scope: language specific tokenizers are meant to be hosted in separate crates.

fulmicoton avatar Jul 18 '22 00:07 fulmicoton