preprocessor
preprocessor copied to clipboard
Fix #2 (punctuations): allows for colons in matching mentions
Mentions in tweets often has colons (@user:). Current regex MENTION_PATTERN = re.compile(r'@\w*') does not search for colons. I changed to MENTION_PATTERN = re.compile(r'@\w*:?') to allow for matching with colons.