lengockyquang

Lỗi khi word_tokenize

9

Hi underthesea, Mình có dùng underthesea phiên bản 1.1.15 thì gặp trường hợp khi sử dụng word_tokenize với cụm danh từ "Cộng hòa Ả Rập" thì có vẻ như word_tokenize...

Allow cancel Invocable with payload on ConsumeQueueOnShutdown

3

Check if invocableWithParams is ICancellableTask, assign its token to give token source. Cancel it on ConsumeQueueOnShutdown

Issue with English-Vietnamese dataset alignment

3

Hi @stefan-it , I just download IWSLT 15 English Vietnamese dataset and i saw some blank in both files. So I tried to remove all blank lines with Notepad++. Then...