deequ icon indicating copy to clipboard operation
deequ copied to clipboard

How do I identify which check the verificationResult belongs to

Open harryson497 opened this issue 3 years ago • 1 comments

When I do the same type of Check for the same Column, THERE is no way to know which Check the verificationResult belongs to, I needed to assign a unique ID to each resultsForAllConstraint to match my Check information before running, and now I have to Run each Check once instead of running all checks at once via addChecks. If I have 5 rules, I Run 5 times. What is the performance impact.A DataFrame is collected five times.

harryson497 avatar Dec 03 '21 06:12 harryson497

I don't have an answer for you, but just letting you know I also ran into the same problem, so you're not alone. My solution was also to run each check independently, which seems terribly inefficient.