signalserver icon indicating copy to clipboard operation
signalserver copied to clipboard

Feature request: Pass/fail reporting

Open ablwr opened this issue 7 years ago • 2 comments

Users would like a high-level overview of groups of files that determine whether something has failed and which files have failed. Dashboard should reveal all files that are failing. Should also be able to click thru to identify further. “Your thing failed, go look at it!”

ablwr avatar May 16 '17 03:05 ablwr

Use Case: user opens SignalServer daily(?) following automated tests. Dashboard summarizes failures for manual investigation + remediation.

Functional:

  • test date, thresholds failed, list of files failed per threshold per date, ability to navigate to problem files in QCTools environment (direct link or some type of path?)

UI: Could be specified further by collapsed summary starting with test date and clicking to open lists individual failures and files: -[Date of test] -+ FAILED | [summary of failed threshold] -- FAILED | [summary of failed threshold] ---file [click to open in QCTools or click thru for source file path or something]

Possible improvement: Ability to export the summary and details (CSV?), e.g., for long term deck monitoring and/or collection/batch-level stats.

kgrons avatar May 19 '17 15:05 kgrons

Thanks so much @kgrons 🎉

ablwr avatar May 19 '17 23:05 ablwr