optimus
optimus copied to clipboard
raystack
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Below are powered via YAML instead of binaries: 1. Survey questions for job_create & job_adhook 2. Plugin Info Changes include: - model `Plugin` to contain `YamlMod` reference to `PluginSpec` which...
### Background If we look at the latest commit (referring to [this](79fdefa1012caed723dd681e3e02eff79830f9e7)), internally we will have migration mechanism being used. The migration `up` is executed whenever we run the server....
proton PR:: https://github.com/odpf/proton/pull/155 Future plans : https://github.com/odpf/optimus/issues/443
Via Optimus CLI user should be able to see logs of the requested Job
When loading a plugin after the discovery phase, when the first GRPC client handshake happens between optimus core and plugin server, don't terminate the application on error instead, simply log...
Currently, job spec `yaml` configuration only supports string key-value pairs. Having string `kv` pairs are fine but passing int(or any other type) should handle the failure gracefully instead of panic....
Optimus supports figuring out dependencies automatically by parsing task assets. This logic of finding dependency is implemented per task behavior. Users can also choose to not depend on the task's...
**Is your feature request related to a problem? Please describe.** Replay feature can be handy as well it can be a problem where it disrupts the regular scheduled runs, by...