Run Build Analysis on pipelines other than those used to enforce merge only on green policy

[matouskozak]

Description

In the dotnet/runtime repository, the policy of merging PR changed so that every PR must have green Build Analysis (no untracked issues/failures) before it can get merged. Runtime repository has many different pipelines, some of which are not 100% reliable, thus only some pipelines are considered for the evaluation of this policy (https://github.com/dotnet/runtime/blob/main/eng/build-analysis-configuration.json).

However, the decision to run Build Analysis on only selected set of pipelines means that "Known Build Error" issues no longer track hits happening on the pipelines outside the selected set. Additionally, re-runs of jobs are no longer enforced, causing a lot of infrastructure (e.g., connection errors to test machines) errors to get reported.

Goal

Execute separate Build Analysis runs for different pipelines but to check if a PR is ok to merge (green CI), only use results from the selected pipelines (https://github.com/dotnet/runtime/blob/main/eng/build-analysis-configuration.json).

---

FYI: @jeffschwMSFT @vitek-karas @steveisok @akoeplinger @lewing

Release Note Category

• [ ] Feature changes/additions
• [ ] Bug fixes
• [ ] Internal Infrastructure Improvements

Release Note Description