datahub
datahub copied to clipboard
feat(ingest/gx) : Add Spark Execution Engine Support for Great Expectation Datahub Validation Action
This commit provides the Spark Execution Engine support for Datahub Validation Action. Unit tests are ran against Great Expectation 0.18.0. For Spark Execution Engine :
- Name of the data source will map to the data Platform name
- Name of the data asset will map to the dataset Entity name
Please note that changes on the Plug In havent been tested for Great Expectation < 0.18.0
@DucNgoQuang , Please also add the documentation for this feature
Please also check the failing testcase