soda-core icon indicating copy to clipboard operation
soda-core copied to clipboard
verified publisher icon sodadata

Ability to Use filters in Cross-checks and

Open rajatm91 opened this issue 3 years ago • 2 comments

HI,

We have a use case where we capture data from multiple RDS database using debezium connector and then use spark-streaming to create a single tables :

image

We want to use cross-check to compare the table on RDS with the corresponding partition on the table on S3. I was checking the documentation of the cross-check and currently it doesn't support filter.

What are plans to support filter in crosscheck ?

rajatm91 avatar Aug 02 '22 07:08 rajatm91

SODA-1018

jmarien avatar Aug 02 '22 07:08 jmarien

I have a similar case to @rajatm91. Do you know if there is any workaround?

miguelbirdie avatar Sep 20 '22 06:09 miguelbirdie