chainer-char-rnn icon indicating copy to clipboard operation
chainer-char-rnn copied to clipboard

Use unicode in load_data function

Open gsever opened this issue 9 years ago • 0 comments

The following command doesn't read all the characters in the text files that I am testing

words = open('%s/input.txt' % args.data_dir, 'rb').read()

instead it would better to read files as:

words = open('%s/input.txt' % args.data_dir, 'r', encoding='utf-8').read()

Thanks.

gsever avatar Sep 29 '15 13:09 gsever