polytracker
polytracker copied to clipboard
Capture Strtok information
Some parsers use strtok to parse input streams. They provide the input string and a delimiter, and it will split the input into chunks. This can help us determine which strings belong to what syntax rules, and provide ground truth on what some delimiters really are.