optimus
optimus copied to clipboard
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Once all Clients start using the new replacement for `buildInsrance` API, i.e. jobRunInput API. 1. delete the `BuildInstance` API 2. deprecate job_run_old and instance table
**Is your feature request related to a problem? Please describe.** Currently to add a new plugin it requires us to create a go file, demands plugin developer to understand some...
**Description** Optimus should provide a mechanism to load the plugins which are defined in Yaml format. **Acceptance Criteria** - [x] The newly added yaml plugins should work at the time...
**Description** All the existing plugins need to support Yaml based specifications which later will be used for client side syncing and rendering of questions as defined in the specification. **Acceptance...
**Description** Provide a command which can inspect an Optimus job using its dependencies, while running certain validations too. **Acceptance Criteria** The command should be able to - [x] Query syntax...
**Is your feature request related to a problem? Please describe.** Currently optimus render tried to address this but it is not complete and proper, as it works only for the...
Currently, the depends-on-past configuration value is being applied in the whole dag. This means the sensors that are created is having the value based on what user's inputted, even though...
**Description** Building upon https://github.com/odpf/optimus/issues/492 , add support for downloading rendered job assets. **Acceptance Criteria** - [ ] Download job assets with support for custom schedule time in specified local directory...
**Description** Provide upstream job runs that the subject job will depend for a given schedule date. **Acceptance Criteria** - [ ] Print List of Upstream job runs for all the...
**Describe the bug** Dependency resolution only happens for the new or modified jobs. However, if there is an issue when resolving dependency for a job, it will notify the one...