optimus icon indicating copy to clipboard operation
optimus copied to clipboard

Provide `Optimus Job inspect` Command

Open Mryashbhardwaj opened this issue 2 years ago • 0 comments

Description Provide a command which can inspect an Optimus job using its dependencies, while running certain validations too.

Acceptance Criteria The command should be able to

  • [x] Query syntax Checks.
  • [ ] ~perform Destination and source table validations & show errors~
  • [x] give Soft warnings
    • [x] if Enabled Catch Up ?
    • [x] If the subject job shares a destination table with an existing job
  • [x] This should work for local job spec & the job in the server
    • [x] User should be provided an option for using local vs server for cli users.
  • [x] Job Add & Deploy Flows should be integrated with these hard validations.

Out of Scope

  1. Job runs details
  2. Dependency jobs data quality metric
  3. compiled assets
  4. perform Destination and source table validations & show errors
    1. this needs to be handled on plugins
    2. Optimus Is unaware of the jobSpecification defined by plugins{BQ2BQ, GCS2BQ}
    3. Based on User Specification what are the Sources? Destination? information current design a plugin is responsible for sharing this information.

Tech Details

  • color scheme
    • hard warning - red
    • soft - yellow
    • information - white
  • if the job already exists in server it should override that job and handle this.

Mryashbhardwaj avatar Aug 02 '22 08:08 Mryashbhardwaj