auditree-arboretum icon indicating copy to clipboard operation
auditree-arboretum copied to clipboard

Persistent failure report

Open drsm79 opened this issue 1 year ago • 0 comments

Overview

It would be good to have a report that highlights persistent failures - checks that consistently fail for many days.

Requirements

  • configurable threshold for persistent failure, measured in time
  • report is a list of check, time period of failure pairs & last successful run (check foo has been failing for 8 days, last successful run $TIMESTAMP)
  • if we were clever, could extend to flapping tests...

Approach

Write a report in https://github.com/ComplianceAsCode/auditree-arboretum/tree/main/arboretum/auditree/reports

Security and Privacy

N/A

Test Plan

Will need some fake result data to demonstrate persistent failure.

drsm79 avatar Jan 19 '24 09:01 drsm79