MLOS Execute Python long haul tests on a schedule

Execute Python long haul tests on a schedule

Open bpkroth opened this issue 4 years ago • 3 comments

@byte-sculptor observed that we are currently missing the Python long haul tests.

We don't necessarily want these in the CI pipelines (they take too long), but we do want to execute them periodically.

To do that, we'll need a separate .github/workflows/scheduled.yml sort of file for the scheduled tasks.

Another task that we'll want to put in there are periodic docker image rebuilds (e.g. to catch security patches). See Also: #36

See Also: https://docs.github.com/en/free-pro-team@latest/actions/reference/events-that-trigger-workflows#scheduled-events

Sep 28 '20 14:09 bpkroth

This currently times out after 6hrs even though the timeout on the job is higher. I'm guessing we run into some Github Action runners limits.

Oct 15 '20 16:10 bpkroth

Seems that didn't work. https://github.com/microsoft/MLOS/actions/runs/318951578

Oct 21 '20 08:10 bpkroth

@byte-sculptor can you look into just decreasing the length of those long haul runs to say 5 hours 55 minutes instead?

Oct 30 '20 20:10 bpkroth