reactionrnn icon indicating copy to clipboard operation
reactionrnn copied to clipboard

UnicodeDecode error on loading in Python 3.6 Anaconda?

Open minimaxir opened this issue 7 years ago • 2 comments

via Reddit:

UnicodeDecodeError                        Traceback (most recent call last)
<ipython-input-54-17136acf3088> in <module>()
      1 from reactionrnn import reactionrnn
      2 
----> 3 react = reactionrnn()

\Anaconda3\lib\site-packages\reactionrnn\reactionrnn.py in __init__(self, weights_path, vocab_path)
     27 
     28         with open(vocab_path, 'r') as json_file:
---> 29             self.vocab = json.load(json_file)
     30 
     31         self.tokenizer = Tokenizer(filters='', char_level=True)

\Anaconda3\lib\json\__init__.py in load(fp, cls, object_hook, parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
    294 
    295     """
--> 296     return loads(fp.read(),
    297         cls=cls, object_hook=object_hook,
    298         parse_float=parse_float, parse_int=parse_int,

\Anaconda3\lib\encodings\cp1252.py in decode(self, input, final)
     21 class IncrementalDecoder(codecs.IncrementalDecoder):
     22     def decode(self, input, final=False):
---> 23         return codecs.charmap_decode(input,self.errors,decoding_table)[0]
     24 
     25 class StreamWriter(Codec,codecs.StreamWriter):

UnicodeDecodeError: 'charmap' codec can't decode byte 0x90 in position 79: character maps to <undefined>

minimaxir avatar Aug 22 '17 03:08 minimaxir

Getting the same problem on iPython Notebook.

sudarshaana avatar Jan 23 '18 15:01 sudarshaana

Changing to binary mode worked for me:

with open(vocab_path, 'rb') as json_file:
    self.vocab = json.load(json_file)

jacobdanovitch avatar Apr 23 '18 17:04 jacobdanovitch