Robert Ambrus

@zuston Do you mean something like this? https://github.com/awslabs/deequ/issues/177 This feature is available in [1.0.3-rc2](https://github.com/awslabs/deequ/releases/tag/1.0.3-rc2), please take a look.

I did some investigation on the Databricks side and found that if the Databricks cluster start fails for any reason, [Get a single job run](https://docs.databricks.com/api/workspace/jobs/getrun) will return this state: ```...

@EngHabu thanks for the hint! looks good to me!

@kumare3 When Databricks TaskConfig is defined, sensitive data (auth) needs to be passed in these fields: - `databricksConf / new_cluster / docker_image / basic_auth / password` - `databricksToken` Do you...