tok-tok icon indicating copy to clipboard operation
tok-tok copied to clipboard

Spanish ¡ not Handled Correctly

Open bargri opened this issue 8 years ago • 1 comments

"¡Hola!" gives "¡Hola !" when it should be giving "¡ Hola !". On the other hand ¿ works as expected, giving: "¿ Hola ?"

This might be fixed by adding ¡ on line 51.

https://github.com/nltk/nltk/blob/develop/nltk/tokenize/toktok.py#L51

bargri avatar Dec 27 '16 09:12 bargri

Thanks for mentioning this. Fixed in ea1f937

jonsafari avatar Dec 30 '16 22:12 jonsafari