training_results_v0.5 icon indicating copy to clipboard operation
training_results_v0.5 copied to clipboard

Published 20 hours ago • verified publisher icon mlcommons

Explicitly use utf-8 encoding

Open Stonesjtu opened this issue 5 years ago • 0 comments

Since it's supposed to deal with non-ascii characters, it's better to ensure open the text file as 'utf-8' encoding.

It fixes my problem when post-processing the corpus.

Stonesjtu avatar Apr 11 '19 21:04 Stonesjtu