bdq
bdq copied to clipboard
tdwg
TG2-MEASURE_VALIDATIONTESTS_NOTCOMPLIANT
| TestField | Value |
|---|---|
| GUID | 453844ae-9df4-439f-8e24-c52498eca84a |
| Label | MEASURE_VALIDATIONTESTS_NOTCOMPLIANT |
| Description | A count of the number of distinct VALIDATION tests that have a Response.status="NOT_COMPLIANT" for a given record. |
| TestType | Measure |
| Darwin Core Class | bdq:Validation |
| Information Elements ActedUpon | |
| Information Elements Consulted | bdq:AllValidationTestsRunOnSingleRecord |
| Expected Response | INTERNAL_PREREQUISITES_NOT_MET if no tests of type VALIDATION were attempted to be run; REPORT of the number of tests of output type VALIDATION run against the record that have Response.result="NOT_COMPLIANT" |
| Data Quality Dimension | Reliability |
| Term-Actions | VALIDATIONTESTS_NOTCOMPLIANT |
| Parameter(s) | |
| Source Authority | |
| Specification Last Updated | 2024-08-22 |
| Examples | [Response.status=RUN_HAS_RESULT, Response.result="37", Response.comment="37 VALIDATION tests had Response.status="NOT_COMPLIANT."] |
| Source | Lee Belbin |
| References | |
| Example Implementations (Mechanisms) | |
| Link to Specification Source Code | |
| Notes | We have three individual measures for pass (MEASURE_VALIDATIONTESTS_COMPLIANT (45fb49eb-4a1b-4b49-876f-15d5034dfc73)), fail (MEASURE_VALIDATIONTESTS_NOTCOMPLIANT (453844ae-9df4-439f-8e24-c52498eca84a)), and PREREQUISITES_NOT_MET (49a94636-a562-4e6b-803c-665c80628a3d). To get the total number of tests that were attempted, add all three measures. To get the total number of tests that ran, add NOT_COMPLIANT (fail) and COMPLIANT (pass). |
Comment by Paul Morris (@chicoreus) migrated from spreadsheet: Either we are using the framework or we are not. If we are using the framework, we must be consistent with it. Validations have results COMPLIANT or NOT_COMPLIANT. Validations have result status values that inform whether the test produced a result or whether for some reason it was not able to run. Therefore we need measures at the data set level of proportion of data compliant, proportion of data not compliant, and proportion of data where the validation could not be run.
Comment by Paul Morris (@chicoreus) migrated from spreadsheet: Name should reflect single-record nature
Comment by Paul Morris (@chicoreus) migrated from spreadsheet: Test name should reflect the framework: SINGLE_RECORD_VALIDATION_COMPLIANT_COUNT or something like that.
@ArthurChapman, as per #134, this is a SINGLE RECORD test (and the resulting count can be accumulated across multiple record/datasets/collections etc).
I suggest the Description:
'The number of distinct VALIDATION tests that have a Response.status="NOT_COMPLIANT" for a given record.'
in place of:
'The number of VALIDATION type tests run on a record that have a Response.status="NOT_COMPLIANT".'
Updated wording of Notes to be consistent with #134 and #135 and to removed internal GitHub cross references.
Splitting bdqffdq:Information Elements into "Information Elements ActedUpon" and "Information Elements Consulted"