lula icon indicating copy to clipboard operation
lula copied to clipboard

Identifier for evaluation threshold

Open brandtkeller opened this issue 9 months ago • 0 comments

Is your feature request related to a problem? Please describe.

lula evaluate is designed to be used to compare two assessments (a threshold assessment and a new assessment) and provide a pass/fail exit output and exit code as a result of being more/equally compliant (pass) or less compliant (fail).

Current this operates on the assumption of two separate assessment files being compared OR the two latest results in a single assessment file.

As Lula looks to make artifact consolidation into a single-file a first class process - we need the ability to store many assessments-results into a single object AND establish a way to identify which result is the threshold.

Example: I may have an assessment result with a single finding (currently the threshold) - I perform another assessment (validate) which is less compliant. I now have two results - if I validate again, current logic would use the 2nd result (which was failing) as my new threshold. Instead I still want to use the original threshold to ensure I maintain a specific level of compliance until the assessment has become more compliant and the threshold needs to be updated

Describe the solution you'd like

  • Given assessment results are being written to a single file
  • When evaluate is executed
  • Then the threshold should be a specific result with some identifier

Additional context

Might be room here for props to be introduced

brandtkeller avatar May 24 '24 14:05 brandtkeller