entity_extractor_by_ner
entity_extractor_by_ner copied to clipboard
solve a bug which will fail to build vocab
The problem is in the file engines/data.py line 108.
old:
tokens = [tokens for token in tokens if token if token not in [' ', '']]
modified:
tokens = [token for token in tokens if token if token not in [' ', '']]