Consider eliminating the runtime shell wrapper

[rousik]

At the moment, some functionality of our pipeline is contained in the wrapper shell script see here.

We might want to consider reducing the complexity contained in this shell script and move some of the functionality into the native python code. That way, the startup layout will be simplified and we will have one source of truth (the python script) for most of this. Some things might even be more powerful (e.g. slack notification could contain some diagnostic information on failure) if we move it to python.

The following functions are performed by shell script:

• [ ] slack notifications (slack-notifications library should do the trick)
• [ ] gcs/s3 file upload
• [ ] shutting down VM (should be handled automatically when moved to batch)

[jdangerx]

related to #3209