ChineseNER icon indicating copy to clipboard operation
ChineseNER copied to clipboard

运行时报错UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa3 in position 0: invalid start byte

Open icysnow123 opened this issue 6 years ago • 3 comments

Traceback (most recent call last): File "main.py", line 227, in if name == "main": File "C:\Python35\lib\site-packages\tensorflow\python\platform\app.py", line 126, in run _sys.exit(main(argv)) File "main.py", line 221, in main clean(FLAGS) File "main.py", line 187, in train

File "main.py", line 87, in evaluate ner_results = model.evaluate(sess, data, id_to_tag) File "C:\pyproject\ChineseNER-master\utils.py", line 66, in test_ner eval_lines = return_report(output_file) File "C:\pyproject\ChineseNER-master\conlleval.py", line 284, in return_report counts = evaluate(f) File "C:\pyproject\ChineseNER-master\conlleval.py", line 74, in evaluate for line in iterable: File "C:\Python35\lib\codecs.py", line 711, in next return next(self.reader) File "C:\Python35\lib\codecs.py", line 642, in next line = self.readline() File "C:\Python35\lib\codecs.py", line 555, in readline data = self.read(readsize, firstline=True) File "C:\Python35\lib\codecs.py", line 501, in read newchars, decodedbytes = self.decode(data, self.errors) UnicodeDecodeError: 'utf-8' codec can't decode byte 0xa3 in position 0: invalid start byte

icysnow123 avatar Apr 24 '18 07:04 icysnow123

in utils.py line 55 with open(output_file, "w") as f:

add encoding="utf8"

ares89 avatar May 02 '18 14:05 ares89

编码问题,加上 #--coding:UTF-8-- 即可

LiXuanming avatar Jun 06 '18 14:06 LiXuanming

thank you

icysnow123 avatar Jun 20 '18 00:06 icysnow123