optimus
optimus copied to clipboard
raystack
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
**Description** This issue is included in [this discussion](https://github.com/odpf/optimus/discussions/479). Under job service and priority resolver, there's a duplicated `populateDownstreamDAGs` in job/service.go is too tied up with Airflow scheduler. The logic itself...
**Description** This issue is part of [this discussion](https://github.com/odpf/optimus/discussions/479). The current (03952e961d54da33aa8daafda45e1d5d3d132d30) job service implementation handles a lot of things, like: * job spec operation * job run creation * job...
**Description** CompileAsset method in `CommandLineMod` interface falls out of place and doesn't fit in the interface. This behaviour is only used in the context of bigquery when the loadmethod is...
**Description** Show the user deployment impact before actually causing any impact **Acceptance Criteria** - [ ] show all validations soft & hard - [ ] show the summary of the...
**Description** Add details of the issue or feature, relevant RFC or discussion thread. **Acceptance Criteria** - [ ] download assets for local as well as a job which is already...
**Description** check for cyclic dependencies [ job_a -> job_b -> job_a ] **Acceptance Criteria** - [ ] emit hard warning if cyclic dependency is found - [ ] should happen...
**Description** This issue is part of [this discussion](https://github.com/odpf/optimus/discussions/479). There are two issues in the mechanism when we want to get upstream resource urn: * we require the whole project spec...
**Description** This is part of [this discussion](https://github.com/odpf/optimus/discussions/479). `PrepareJobSpecMap` is being used by Replay, ReplayDryRun, and Backup to get the lineage of the requested job. This is not necessary, too complex,...
**Description** Add details of the issue or feature, relevant RFC or discussion thread. **Acceptance Criteria** - [ ] handle for static, inferred and external dependencies - [ ] upstream job...
**Description** Add replay feature as a sub domain for replay inside scheduling domain. **Acceptance Criteria** - Replay functionality can be a separate subdomain as part of scheduling domain. Depends on...
