maestro icon indicating copy to clipboard operation
maestro copied to clipboard

[Feature Request] Add option to disable automatic retry

Open danielbyondd opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. Our team has 29 tests, and they take over an hour to execute (we don't know exactly how long because the Bitrise job times out after 60 mins). Executing the same suite of tests locally takes ~20 mins.

We've only had a handful of teams onboard to writing Maestro tests, and I can easily see our suite reaching over 100 tests this year, so it's critical we keep our execution times down. If our tests are going to fail, they will almost always fail due to bad test store data (since sometimes our test stores can be changed by other teams, breaking our UI tests), not due to any kind of network flakiness. Those intermittent network issues might exist, but would be infrequent, and re-running those specific failed tests would be much faster than blanket retrying every failed test.

Bitrise job Screenshot 2024-01-09 at 2 23 30 PM

Local execution Screenshot 2024-01-09 at 2 22 42 PM

Describe the solution you'd like An option to disable automatic retry for the maestro cloud command (and associated Bitrise step). This would just cause Maestro Cloud to report a flow as failed the first time it fails

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

danielbyondd avatar Jan 09 '24 22:01 danielbyondd