lula
lula copied to clipboard
Identifier for evaluation threshold
Is your feature request related to a problem? Please describe.
lula evaluate
is designed to be used to compare two assessments (a threshold assessment and a new assessment) and provide a pass/fail exit output and exit code as a result of being more/equally compliant (pass) or less compliant (fail).
Current this operates on the assumption of two separate assessment files being compared OR the two latest results in a single assessment file.
As Lula looks to make artifact consolidation into a single-file a first class process - we need the ability to store many assessments-results into a single object AND establish a way to identify which result is the threshold.
Example: I may have an assessment result with a single finding (currently the threshold) - I perform another assessment (validate) which is less compliant. I now have two results - if I validate again, current logic would use the 2nd result (which was failing) as my new threshold. Instead I still want to use the original threshold to ensure I maintain a specific level of compliance until the assessment has become more compliant and the threshold needs to be updated
Describe the solution you'd like
- Given assessment results are being written to a single file
- When evaluate is executed
- Then the threshold should be a specific result with some identifier
Additional context
Might be room here for props
to be introduced