Allow custom character ranges in token definition

[gdetrez]

From the ML:

I would appreciate if own character ranges would be supported and not only the predefined digit, letter, upper, lower character ranges or simple unions... a use case could be accented characters for example...

[neu-rah]

character ranges would be very useful to translate from w3c-ebnf where very large chunks of unicode characters have to be validated