sravankorumilli
sravankorumilli
Current approach of replay interferes withe the scheduled jobs, there is a need for the replayed jobs should n't interfere with the scheduled jobs https://github.com/odpf/optimus/blob/main/docs/docs/rfcs/20220525_replay_rate_limiting.md
Observability is a key in any mature product, as part of this we would improve various aspects of observability logging, tracing and metrics and provide the relevant dashboards.
Job Deployment is pretty slow due to repeated dependency resolution and there is a scope for inconsistency due to modified resources after the job creation.
There is an observation around multiple conversions, lets analyse whether we can simplify this. Job Yaml tranform to models.Job -> Job Yaml for persistence Job Yaml tranform to models.Job ->...
As part of this story, we expect all the dependent jobs to be recompiled to do the dependency resolution and persist the dependencies accordingly. Any failures in the dependent jobs...
**Is your feature request related to a problem? Please describe.** The better the logging the better we understand what is happening in the system. That improves efficiency of the developers...
Jobs and Resources are connected, the connections to be presented to the users both static and runtime view which aids in better debuggability of any issues.