C++ Tokenizer implementation

[OlivierBinette]

Check if release PR fulfills these requirements

• [ ] Changelog has been updated and breaking changes have been marked (if any).
• [ ] Tests have been added if necessary.

Type of change

• [ ] Breaking changes.
• [ ] Backward compatible feature additions.
• [ ] Backward compatible bug fixes.

Additional comments and description of changes