optimus
optimus copied to clipboard
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
## TL;DR This issue proposes to revamp the current implementation to use proper pointer whever possible instead of value to address possible issues caused by side effect and memory consumption....
**Description** Any plugin which needs to go through Auth over http should be supported by plugin manager. **Acceptance Criteria** - [ ] Should provide a mechanism to configure the auth...
**Description** Inorder to avoid installation of plugins there is a need for syncing just the questions to the users for better cli experience. Refer: [RFC - Simplify Plugins](https://github.com/odpf/optimus/blob/main/docs/docs/rfcs/20220507_simplify_plugin_maintenance.md) **Acceptance Criteria**...
### Background If we look at the current documentation, like README.md (latest commit [here](79fdefa1012caed723dd681e3e02eff79830f9e7)) or the [blog documentation](https://odpf.github.io/optimus/docs/introduction), there is no guide being provided to setup local for development. A...
Observation: Optimus is using more memory than expected, and gets evicted out of cluster for breaching memory limits. To reduce the amount of memory used by application, we can pass...
In some of store methods, the data is queried from multiple tables, where we fetch the associations. This should not be required in most of the cases. We can simplify...
As part of this card, we expect a new api for fetching compiled job specs instead of the current approach where we have a side effect of registering the job...
users should be provided with an optimus playground command through which users are guided interactively to know more about some key areas in optimus. 1. windowing 2. render As part...