Ian Henderson

Sure, that sounds fine -- to be clear, the token would match hex integers like `ABC` rather than `0xABC`, right? I'd also say the name of the token class should...

Though, on second thought, there's an issue of which token type has priority between `identifier`, `integer`, and `hex-integer`, since `3` could be either decimal or hexadecimal and `A` could be...

There are two big things I'd want here that POSIX regexes can't provide: **token-level ambiguity detection** If there are two rules like `[0-9]+` (for integers) and `[0-9]+(\.[0-9]*)?` (for real numbers)...

Thanks for looking into this! What did you use to make these diagrams? I think this is the kind of change I'd ultimately like to make myself, so I know...

Thanks for trying owl, and for the clear description of this problem! I'm planning to add support for custom tokens soon (see #2). To support this use case, that ought...

I agree this would be useful; the tough part is defining exactly when the "other" token would end. I'm planning to add custom token support soon, which may take care...

Would you mind giving a few examples of strings and how you'd want them to be tokenized? The reason conflicts are resolved in this order is to allow you to...

I just came across this PR and felt compelled to mention—my personal website is http-only, so this change would cause me to lose my verification.

The following diff fixes the issue for me. Let me know if you'd like a pull request. ```diff 400c400,416 < #block_comment --- > #nested_block_comment > > > > nested_block_comment >...

I’m running into this issue today (I’m on mastodon.social; the other accounts are on a variety of instances). It’s frustrating to have to write down every account in my notes...