tok-tok
tok-tok copied to clipboard
Spanish ¡ not Handled Correctly
"¡Hola!" gives "¡Hola !" when it should be giving "¡ Hola !". On the other hand ¿ works as expected, giving: "¿ Hola ?"
This might be fixed by adding ¡ on line 51.
https://github.com/nltk/nltk/blob/develop/nltk/tokenize/toktok.py#L51
Thanks for mentioning this. Fixed in ea1f937