dataframe-rules-engine
dataframe-rules-engine copied to clipboard
databrickslabs
Extensible Rules Engine for custom Dataframe / Dataset validation
DLT looking good, dataframe-rules-engine is a labs project but the usefulness of this is so good. Are the maintainers still hot on this project.
Hi In the validation report, I would like to aggregate other values in my dataframe. For example, if I have amount that >100, I would like to sum the total...
This commit corrects a display-only bug in the validation results when expression type Rules are used. Previously, the `permitted` column would display the Rule expression as a String. This commit...
Fixes [#3]. This commit adds a Python Wrapper to the DataFrame Rules Engine project. In particular, this commit adds the following functionality in Python: - Define a Rule using a...
@GeekSheikh I would like to start working on Python wrapper for this. Can i start on that?
Optional description should be added for Rule and RuleSet This would allow groups wanting to describe the purposes of more complex rules the ability to do so. The description should...
Given the rule, some anomalous data could be allowed. Assume a DF with 100 million records, does 1 record out of bounds by 0.0001 % fail the entire test? User...
[Breeze](https://breeze.github.io/doc-java-hib/) -- Behavior based framework [Gherkin/Cucumber](https://cucumber.io/docs/gherkin/)
Enable an external table to host the rules and have rules compiled from externally managed source.
The integration of other packages will enable additional patterns to work with the Rules Engine. Ultimately, these are expected to be encoded into expectations/rules but this will alleviate the switching...
Metadata
Owner
Metadata
Extensible Rules Engine for custom Dataframe / Dataset validation