报错 RuntimeError: Invalid UTF-8 sentence!
ltp为4.2.0。代码如下 `
output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"])
seg = output.get("cws")[0]
postags = output.get("pos")[0]
arcs = output.get("dep")[0]
roles = output.get("srl")[0]
`
结果报错:
Traceback (most recent call last): File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 190, in
triple = extractor.triples_main(row['输入文本']) File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 170, in triples_main words, postags, child_dict_list, roles_dict, arcs = self.parser.parser_main(sentence) File "E:\PycharmProjects\Llama-API-Deploy\triple_extract.py", line 47, in parser_main output = self.ltp.pipeline([sentence], tasks=["cws", "pos", "dep", "srl"]) File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper return func(*args, **kwargs) File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 185, in pipeline store[task] = self.post[task](result, hidden, store, inputs, tokenized) File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 24, in wrapper return func(*args, **kwargs) File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in _cws_post words = [self.hook.hook(t, w) for t, w in zip(inputs, words)] File "C:\ProgramData\Anaconda3\lib\site-packages\ltp\nerual.py", line 282, in words = [self.hook.hook(t, w) for t, w in zip(inputs, words)] RuntimeError: Invalid UTF-8 sentence!
看全网都没有遇到这个报错。有人知道吗