optimus
optimus copied to clipboard
raystack
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
**Description** As part of this we will introduce a domain for dealing with jobs which are scheduled on are in running state. **Acceptance Criteria** - All the code related to...
**Description** Add domain module to handle the core job management domain. We need to encapsulate the dependency resolution and other pieces so that they can only be access by proper...
**Description** Create a module to handle and encapsulate the logic related to resource management. **Acceptance Criteria** - [ ] All handlers, service etc are present in the module. - [...
**Description** All the code related to tenancy like project, namespace and secret will move to a module which contains all the code related to working with tenancy inside the application....
### Discussed in https://github.com/odpf/optimus/discussions/501 Originally posted by **smarch-int** August 8, 2022 Currently we are limited to override single plugin config using this.yaml. This limitation needs to be addressed by allowing...
**Description** Plugins which are just defined through yaml should have means to provide destination & sources for automated dependency resolution to happen. **Acceptance Criteria** **Scope** - [ ] Provide the...
**Description** We are using gorm to query the postgres database, in the current implementation we are facing issues related to high memory consumption which can be due to way be...
**Description** Currently, only the latest documentation is published, there is a need for publishing documentation based on the affected releases. Such that it is clear for users on the expected...
**Description** The documentation should be very detailed to understand the concepts, how to deploy, how to run in local.
**Description** To facilitate the migration of stores away from gorm, we will need to cover all the stores with benchmark so that we can identify the changes in performance. **Acceptance...