arcade icon indicating copy to clipboard operation
arcade copied to clipboard

[Build Analysis Page UX] Show all the errors

Open AlitzelMendez opened this issue 2 years ago • 3 comments

  • [ ] This issue is blocking
  • [ ] This issue is causing unreasonable pain

Feedaback: Not all errors are shown in this page ⛔ -- Displays message "N other jobs are failing and were not displayed due to space limitations. This significantly lowers the value of "Build Analysis" page in general ⚠️ As this page might not contain everything, it is easier to go straight to runtime pipeline page, as it will contain everything straight away.

There is no way to achieve this on the build analysis page due to the 65k character limitation. We can’t show all the errors on the build analysis if there are a lot of errors. Our biggest concession has been increasing the number of results shown, but even this has caused a lot of problems towards the 65k character limit. At this point, we consider that build analysis is providing all the information if a couple of tests failed, or the build failed with a couple of errors. However, in cases with a lot of errors, we can’t provide this.

The only workaround would be using the Landing Page, but this would require doing a lot of build analysis work again. I’m not sure if people would still prefer to go to the pipelines when we are in this scenario.

At this point, the focus of the epic is towards known issues and this particular scenario is not impacting known issues. If all the tests are known issues, this will be reported on build analysis which is the expected. For the known issue listing errors, we can close this gap on the landing page when not all known issues are listed. However, for this epic, I think the focus is less on build analysis, so for the build analysis part, we can look at this later.

Release Note Category

  • [ ] Feature changes/additions
  • [ ] Bug fixes
  • [ ] Internal Infrastructure Improvements

Release Note Description

AlitzelMendez avatar May 08 '23 22:05 AlitzelMendez

Unfortunately, there is nothing we can actually do here. Build analysis is limited by the character limit of GitHub check run, which is 65k at this point: https://docs.github.com/en/search?query=Maximum+length%3A+65535+characters

closing issue as we can't take any action on this

AlitzelMendez avatar Jul 28 '23 17:07 AlitzelMendez

@AlitzelMendez Is there a way to see all the non-known failures for a build on https://helix.dot.net/BuildAnalysis? A recent build ran out of space and didn't include the unique test failures, and I can't find them in the build information page on https://helix.dot.net/BuildAnalysis/SearchBuild?BuildId=1110673. There's only known issues, which is much less helpful for trying to fix the failures caused by my PR.

jtschuster avatar Aug 01 '25 21:08 jtschuster

@dotnet/dnceng can you take a look on this?

AlitzelMendez avatar Oct 22 '25 19:10 AlitzelMendez