[Feature Request] CLI test runner

[DanTalash]

We need to be able to integrate our tests into our CI/CD pipelines, which means being able to invoke them from the command line and receive a result. This would ideally be a linux cli executable that we could point to a .json collection file and have it run all (or a subset) of the tests, generate a report, and return an appropriate exit code.