lwjson
lwjson copied to clipboard
Add support for token counter feature
This is to be used by user prior input token set allocation.
Using this feature, user can check if input is valid and can understand how many tokens are necessary for successful JSON parsing.