optimus
optimus copied to clipboard
Provide `Optimus Job inspect` Command
Description Provide a command which can inspect an Optimus job using its dependencies, while running certain validations too.
Acceptance Criteria The command should be able to
- [x] Query syntax Checks.
- [ ] ~perform Destination and source table validations & show errors~
- [x] give Soft warnings
- [x] if Enabled Catch Up ?
- [x] If the subject job shares a destination table with an existing job
- [x] This should work for local job spec & the job in the server
- [x] User should be provided an option for using local vs server for cli users.
- [x] Job Add & Deploy Flows should be integrated with these hard validations.
Out of Scope
- Job runs details
- Dependency jobs data quality metric
- compiled assets
- perform Destination and source table validations & show errors
- this needs to be handled on plugins
- Optimus Is unaware of the jobSpecification defined by plugins{BQ2BQ, GCS2BQ}
- Based on User Specification what are the Sources? Destination? information current design a plugin is responsible for sharing this information.
Tech Details
- color scheme
- hard warning - red
- soft - yellow
- information - white
- if the job already exists in server it should override that job and handle this.