playground icon indicating copy to clipboard operation
playground copied to clipboard

Run nightly tests to have a chance detecting flakiness

Open invidian opened this issue 4 years ago • 1 comments

Expected Behaviour

Every day e2e tests runs to ensure everything is functioning as expected.

Current Behaviour

Currently, some users may hit things like https://github.com/tinkerbell/osie/issues/183, which does not happen all the time.

Possible Solution

Configure GitHub Action to run every night, so build fails are reported via email.

invidian avatar Jan 15 '21 13:01 invidian

Seems reasonable. My concern here is that folks will just ignore the flake e-mails. The next extension from here is automatic issue opening.

tstromberg avatar Aug 27 '21 16:08 tstromberg

Unfortunately at the moment manual testing is all that @chrisdoherty4 and I are able to provide. A roadmap item has been opened for discussion and community help. https://github.com/tinkerbell/roadmap/issues/32

jacobweinstock avatar Nov 07 '23 00:11 jacobweinstock