klpt icon indicating copy to clipboard operation
klpt copied to clipboard

tokenization with word ending with "iy" instead of "îy"

Open sinaahmadi opened this issue 11 months ago • 0 comments

In Kurmanji, words ending with "î" when inflected with a form starting with "î" undergo an alternation where the "îî" becomes "iy" in contrast to "îy". That should be included in the tokenization module to make sure that the correct word forms are looked up in the dictionary.

dîplomasiyê / dîplomasîyê

sinaahmadi avatar Jul 17 '23 16:07 sinaahmadi