FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Specific UTF-8 character problem

Open begumcitamak opened this issue 2 years ago • 0 comments
trafficstars

Hi, I'm trying to print "İ" and "ı" characters when im chatting from console. I'm using FastChatT5. Here is my output.

image

I think it might be encoding, but ü and ö characters can be printed properly. I suspected lowercase was applied when preprocessing, but couldn't find a clue. Does anyone know the solution to this problem?

Thanks,

begumcitamak avatar Jun 14 '23 14:06 begumcitamak