py-tree-sitter
py-tree-sitter copied to clipboard
How tokenize a piece of code?
Hello guys,
I was wondering which is the fastest way to tokenize a parsable piece of code, let's say a method.
Thank y'all in advance.