optimus
optimus copied to clipboard
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Job Deployment is pretty slow due to repeated dependency resolution and there is a scope for inconsistency due to modified resources after the job creation.
There is an observation around multiple conversions, lets analyse whether we can simplify this. Job Yaml tranform to models.Job -> Job Yaml for persistence Job Yaml tranform to models.Job ->...
If we check the current implementation, we have `mock` package to store any mock structure for testing purposes. Instead of using `mock`, I suggest to change it into `mocks` instead....
Differently formatting message, such as coloring message, could help the user to notice on something important. But, the current implementation of providing log could be improved. As observed, the following...
At the load of the project we query all the secrets and keep them for use if any piece of code requires them. With this story we will consume the...
As part of this story, we expect all the dependent jobs to be recompiled to do the dependency resolution and persist the dependencies accordingly. Any failures in the dependent jobs...
**Is your feature request related to a problem? Please describe.** The better the logging the better we understand what is happening in the system. That improves efficiency of the developers...