feature: allow tokenization of files

[EllingtonKirby]

Apologies, I cannot find the Template on the Issues Page so I will do my best to describe the feature. I am working on a project where I found this change helpful so I figure why not try and add it to the project.

Adds the ability to tokenize files. Basically works identically to the clean_file function but instead repeatedly calls the tokenize function.

Added unit tests and new test files.

Tests pass on my machine, MacOS Monterey 12.5.1

[Sdsmetamask]

Merge with

[Deepakratta]

well