klpt
klpt copied to clipboard
in_separator in mwe_tokenize doesn't work properly
The argument in_separator
seems to be overwritten at the end of the mwe_tokenize function. The argument is not accessible through word_tokenizer
either.