Add dry run option to scheduler CLI and refactor phase recording

[racicLuka]

[racicLuka]

I don't like the part about passing the no_plan_result arg to the run_plans_and_cleanup function, but not sure what would be a better way to do it.

[jherbel]

I don't like the part about passing the no_plan_result arg to the run_plans_and_cleanup function, but not sure what would be a better way to do it.

Agreed, but I don't have a better idea atm either