entity_extractor_by_ner icon indicating copy to clipboard operation
entity_extractor_by_ner copied to clipboard

solve a bug which will fail to build vocab

Open weiambt opened this issue 1 year ago • 0 comments

The problem is in the file engines/data.py line 108.

old:

tokens = [tokens for token in tokens if token if token not in [' ', '']]

modified:

tokens = [token for token in tokens if token if token not in [' ', '']]

weiambt avatar Mar 18 '24 08:03 weiambt