homebrew-test-bot icon indicating copy to clipboard operation
homebrew-test-bot copied to clipboard

Upload `test-bot` results from Homebrew/core to BuildPulse

Open carlocab opened this issue 3 years ago • 2 comments

We need a better sense of which Homebrew/core tests are flaky, and the best way to do that is to use BuildPulse, which we already do in Homebrew/brew.

We already have some code in place that enables this. All that remains to be done is to upload this to BuildPulse. See discussion at #699.

I hope to be able to work on this at some point, but I'd also love it if someone else picked it up before I did.

carlocab avatar Nov 12 '21 13:11 carlocab

Thanks for writing this up @carlocab!

MikeMcQuaid avatar Nov 12 '21 13:11 MikeMcQuaid

All that remains to be done is to upload this to BuildPulse.

I might be understating the work left to be done a little here. There is a brew-test-bot.xml file in each bottles artifact, but it appears to occasionally be empty (e.g. #89272). When it's not, it will only contain a copy from only one of the runners when there should be six (one for each build we attempt).

carlocab avatar Nov 12 '21 16:11 carlocab

Passing on this.

MikeMcQuaid avatar Mar 23 '23 12:03 MikeMcQuaid