sql-formatter icon indicating copy to clipboard operation
sql-formatter copied to clipboard

Tokenize purely using regexes

Open mvorisek opened this issue 8 months ago • 0 comments

Match next token using single regex only, +18% speedup.

In the future, Tokenizer::makeTokenizeRegexes() method can be made public to allow grammar override for each token type.

mvorisek avatar Jun 04 '24 08:06 mvorisek