DataQualityDashboard
DataQualityDashboard copied to clipboard
Should DQD run measureValueCompleteness SQL when threshold is 100?
The measureValueCompleteness will pass when the threshold is 100. Do people look at passed checks except to say, 'look DQD passed xxx out of a possible yyy checks'. Checking every column or every row is expensive.
We actually also look at checks that pass, but do have records violating the check. Especially on a first run of DQD where you use the default thresholds.
I would argue that we need two different kinds of Pass statuses: 'Pass without failed rows' and 'Pass with failed rows'. Similar how we are introducing different Fail statuses (>threshold, error, na)
@MaximMoinat I like that a lot. I will add it to our board for v2.0