DataQualityDashboard icon indicating copy to clipboard operation
DataQualityDashboard copied to clipboard

Add "resume" option

Open ganisimov opened this issue 2 years ago • 1 comments

It happens that due to connection issues or other conditions executeDqChecks fails and progress is lost. Resume option allows to recover progress of previous execution.

Once certain check is processed without error, it's saved to file corresponding to check description. If overall execution completes without errors these intermediate files are deleted.

When resume option is set to TRUE and intermediate results for certain check exist, processing of the check is skipped and saved results are used instead.

ganisimov avatar Aug 26 '22 11:08 ganisimov

This addresses #109

ganisimov avatar Aug 26 '22 11:08 ganisimov

@ganisimov thank you for this! We recently refactored the R functions into separate files on the develop branch. Would you be able to move your changes to the executeDqChecks.R file on develop?

clairblacketer avatar Oct 07 '22 19:10 clairblacketer

@clairblacketer , thank you for looking into this! I created another PR #395.

ganisimov avatar Oct 19 '22 16:10 ganisimov