arcade icon indicating copy to clipboard operation
arcade copied to clipboard

Production - [Alerting] Pipelines found by Queue Insights

Open dotnet-eng-status[bot] opened this issue 3 years ago • 158 comments

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

@dotnet/dnceng, please investigate

Automation information below, do not change

Grafana-Automated-Alert-Id-c46b0e6e219e4900850b28ea49c37f63

dotnet-eng-status[bot] avatar Sep 01 '22 02:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 03:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 03:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 04:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 04:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 04:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 07:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 07:09 dotnet-eng-status[bot]

this is very similar to issue https://github.com/dotnet/arcade/issues/10709. The question here (as I see) is why do we have duplicate github issue here?

andriipatsula avatar Sep 01 '22 09:09 andriipatsula

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 12:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 12:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 13:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 13:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 14:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 14:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 15:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 16:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 16:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 16:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 17:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 17:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 19:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 19:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • queues 0.5

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 19:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 20:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 21:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 22:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 01 '22 22:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 02 '22 00:09 dotnet-eng-status[bot]

:broken_heart: Metric state changed to alerting

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

  • buildMachines 0
  • queues 0

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 02 '22 01:09 dotnet-eng-status[bot]

:green_heart: Metric state changed to ok

Queue Insights was not able to determine essential data in the check, either the queues, build machines, or the pipelines a PR is using. This typically means there was an error parsing data from the Matrix of Truth.

Wiki Page: https://dev.azure.com/dnceng/internal/_wiki/wikis/DNCEng%20Services%20Wiki?wikiVersion=GBwikiMaster&pagePath=/FR%20Operations/Wiki%20for%20Grafana%20Alerts/%5BAlerts%5D%20Queue%20Insights&pageId=956&_a=edit

Metric Graph

Go to rule

dotnet-eng-status[bot] avatar Sep 02 '22 02:09 dotnet-eng-status[bot]