phileas
phileas copied to clipboard
POS post filter does not handle multi-word tokens
Given the input:
"George Washington was president and his ssn was 123-45-6789 and he lived at 90210."
The POS filter fails because the tokens are "George" and "Washington" individually and not "George Washington." The filter needs changed to allow for multi-word tokens.