datacompy Tolerance for select fields

Tolerance for select fields

Open mehulpatel21 opened this issue 3 years ago • 3 comments

Is it possible to add abs_tol and rel_tol to a list of fields instead of the whole dataframe? How do we achieve this using SparkCompare?

Aug 27 '22 18:08 mehulpatel21

You could subset your data and run compare only on those if you really need it. I think it happens on a entire dataframe level at the moment though.

If there is enough interest in this feature it is something we can look into as a feature request.

Aug 29 '22 12:08 fdosani

@mehulpatel21 Just following up on this. Are you able to use my suggestion. Just wondering if there was anything else I could help with here.

Sep 01 '22 13:09 fdosani

Hi, thanks for your response. I haven't gotten a chance to play around with the suggestion you provided yet. I will let you know once I am able to!

Sep 01 '22 13:09 mehulpatel21

Closing this issue as I haven't heard back. Please feel free to reopen if needed

Apr 24 '23 17:04 fdosani