OpenMetadata icon indicating copy to clipboard operation
OpenMetadata copied to clipboard

[Data Quality] Add a where clause to test cases

Open sushi30 opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. As a platform user, I would like to set a custom WHERE clause when specifying data for data quality tests.

Describe the solution you'd like When adding a test case (table or column) I would like to add a custom where clause to the test case so that the test is run only on a subset of the data. This can be used to designate test cases for specific subsets of the data (based on event type, date, conditional field).

Example: I would like to test that all orders that were submitted on platform=mobile have an os in `['android','ios'].

Describe alternatives you've considered

  1. Using custom SQL - this is limited only to technical users and it does not benefit from the detailed report that is extracted by OMD's pre-defines tes definitions.
  2. Using the profiling sample - this is a global configuration so it will impact all test cases on the table. I would like a filter specific for my test case / test suite.

Screenshots

I would like this screen:

Screenshot 2024-04-26 at 10 57 54

To have a menu similar to this:

Screenshot 2024-04-26 at 10 57 28

sushi30 avatar Apr 26 '24 09:04 sushi30