FsLex, reg set lexing, classical lexing unification

[gsvgit]

Create unified tool based on FsLex for classical lexers and lexers for regular set tokenization generation.

• [x] FsLex and Abstract lexing generator and runtime unification.
  • Abstract lexing sources: \src\AbstractLexer.*
  • FsLex\Yacc: \src\FsLex* \src\FsYacc*
  • [x] Replace FsLex usages with result of unification
• [ ] Full unicode support. Synchronize with task #63 .
• [ ] Case sensitive|insensitive switch for case sensitive|insensitive languages processing
• [ ] Recursive FA support.
• [x] Flag for switch classical lexer or lexer for SEL generation.

[gsvgit]

Regular set lexing