[Build Analysis Page UX] Show all the errors
- [ ] This issue is blocking
- [ ] This issue is causing unreasonable pain
Feedaback:
Not all errors are shown in this page ⛔ -- Displays message "N other jobs are failing and were not displayed due to space limitations. This significantly lowers the value of "Build Analysis" page in general ⚠️ As this page might not contain everything, it is easier to go straight to runtime pipeline page, as it will contain everything straight away.
There is no way to achieve this on the build analysis page due to the 65k character limitation. We can’t show all the errors on the build analysis if there are a lot of errors. Our biggest concession has been increasing the number of results shown, but even this has caused a lot of problems towards the 65k character limit. At this point, we consider that build analysis is providing all the information if a couple of tests failed, or the build failed with a couple of errors. However, in cases with a lot of errors, we can’t provide this.
The only workaround would be using the Landing Page, but this would require doing a lot of build analysis work again. I’m not sure if people would still prefer to go to the pipelines when we are in this scenario.
At this point, the focus of the epic is towards known issues and this particular scenario is not impacting known issues. If all the tests are known issues, this will be reported on build analysis which is the expected. For the known issue listing errors, we can close this gap on the landing page when not all known issues are listed. However, for this epic, I think the focus is less on build analysis, so for the build analysis part, we can look at this later.
Release Note Category
- [ ] Feature changes/additions
- [ ] Bug fixes
- [ ] Internal Infrastructure Improvements
Release Note Description
Unfortunately, there is nothing we can actually do here. Build analysis is limited by the character limit of GitHub check run, which is 65k at this point: https://docs.github.com/en/search?query=Maximum+length%3A+65535+characters
closing issue as we can't take any action on this
@AlitzelMendez Is there a way to see all the non-known failures for a build on https://helix.dot.net/BuildAnalysis? A recent build ran out of space and didn't include the unique test failures, and I can't find them in the build information page on https://helix.dot.net/BuildAnalysis/SearchBuild?BuildId=1110673. There's only known issues, which is much less helpful for trying to fix the failures caused by my PR.
@dotnet/dnceng can you take a look on this?