datahub icon indicating copy to clipboard operation
datahub copied to clipboard

feat(ingest/gx) : Add Spark Execution Engine Support for Great Expectation Datahub Validation Action

Open DucNgoQuang opened this issue 1 month ago • 2 comments

This commit provides the Spark Execution Engine support for Datahub Validation Action. Unit tests are ran against Great Expectation 0.18.0. For Spark Execution Engine :

    - Name of the data source will map to the data Platform name 
   
    - Name of the data asset will map to the dataset Entity name 

Please note that changes on the Plug In havent been tested for Great Expectation < 0.18.0

DucNgoQuang avatar Nov 20 '25 09:11 DucNgoQuang

@DucNgoQuang , Please also add the documentation for this feature

deepgarg760 avatar Dec 04 '25 14:12 deepgarg760

Please also check the failing testcase

deepgarg760 avatar Dec 04 '25 14:12 deepgarg760