LM-BFF icon indicating copy to clipboard operation
LM-BFF copied to clipboard

How can I create templates for right to left languages?

Open moeyad7 opened this issue 1 year ago • 0 comments

I am trying to apply LM-BFF to some sentiment analysis datasets and Named Entity Recognition in Arabic. I am having difficulties in creating the templates as the order in which I write the template in is not what is outputted when I run the model.

12/17/2023 21:53:54 - INFO - __main__ -   | *cls**sent_0*كانت**mask*.*sep+* => *cls**sent_0*كانت**mask*.*sep+**sent_1*كانت**label_0*.*sep+**sent_2*كانت**label_1*.*sep+*

According to the pattern, I wrote the template should output [CLS] sent_0 كانت [MASK]. [SEP] sent_1 كانت [MASK]. [SEP] but the output that is returned is [CLS] كانت sent_0 [MASK]. [SEP] sent_1 كانت [MASK]. [SEP]. For some reason the first part of the template get switched I don't know if its because I am using a right to left language or if my template is wrong.

moeyad7 avatar Dec 17 '23 22:12 moeyad7