enceladus
enceladus copied to clipboard
AbsaOSS
Dynamic Conformance Engine
## Background Even mapping tables can evolve. But it can be out of sync of the report date of the regular job. ## Goal Support the idea of `Latest` in...
## Background When SparkSubmit fails in helper scripts, there is nothing, it just quits the script. SparkSubmit failing in a sense that it does not even get to start the...
As part of the migration to AWS, and Enceladus being part of the ecosystem, we are to support E2E testing on selected datasets: - [x] Bucket names to read data...
## Background In #1906 , there is a validation for the target column, but not for the provided Spark expression against the mapping table schema ## Feature Validate that the...
## Background On a heavier database, Menas is quite slow ## Feature Implement caching on the backend to improve performance
## Describe the bug `path` in `SchemaField` for the root fields is not filled/populated during upload. It is not validated in any way. Now we have old schemas with this...
## Background I find specific classpaths tedious and constraining if wanted to restructure. Also to have to specify such long string is error-prone. ## Feature Implement one proper Main class...
## Background Currently, we have no functionality to do case clauses in the Menas UI: The types of rules that require this functionality have been done through the API rather...
## Background The current implementation for Getting statistics could get really slow because there are multiple db requests for each property. ## Feature Implement a more efficient generation of properties...
## Background Sometimes it happens that the _Helper scripts_ can get out of sync with the _SparkJobs_ version. This can limit some features. ## Feature There's a version already in...