Chatette icon indicating copy to clipboard operation
Chatette copied to clipboard

Does this tool support chinese?

Open RayShark opened this issue 4 years ago • 1 comments

I just wondering whether this tool support chinese corpus.

For example, do i suppose to use Jieba or other chinese tokenizer ? And is there interface reserved for chinese tokenizer...

Thanks a lot.

RayShark avatar Sep 08 '21 08:09 RayShark

是的,只需要将文件读取改为utf-8的格式读取即可

gaojunyu21 avatar Apr 30 '24 07:04 gaojunyu21