flutter icon indicating copy to clipboard operation
flutter copied to clipboard

Revisit: Retrying in the merge group

Open jtmcdole opened this issue 7 months ago • 2 comments

When monorepo was started, Mac bots were highly flakey in the merge group. We have automatic retries in these cases and it was very helpful to retry one or two bots.

Mac bots are way more stable now thanks to the teams efforts (🥳) but now the retries are blocking the merge group when there are real failures (e.g. https://github.com/flutter/flutter/pull/169187)

We should probably:

  1. Reduce the retry count in the merge group
  2. Attempt to see if errors are real and fail fast
  3. If we see multiple errors from different builders, fail fast.

Thoughts @matanlurey @zanderso ?

jtmcdole avatar May 23 '25 18:05 jtmcdole

Reducing retries if the stability problems they were hacking around are gone sgtm.

zanderso avatar May 23 '25 18:05 zanderso

Reducing retries if the stability problems they were hacking around are gone sgtm.

That sound be easy to verify. I'd like to also have orchestrators fail fast if a sub build fails in the merge group. Anything to get positive failures back to the PR sooner (and let good PRs through).

jtmcdole avatar May 23 '25 22:05 jtmcdole

Let's give adjusting a shot!

matanlurey avatar May 24 '25 02:05 matanlurey