dbx icon indicating copy to clipboard operation
dbx copied to clipboard

Published 20 hours ago • verified publisher icon databrickslabs

[Feature] `dbx destroy` command for cleaning up jobs

Open ilyasotkov opened this issue 2 years ago • 2 comments

dbx deploy will create/update jobs in Databricks, but I haven't found a straightforward way to clean up these jobs. Would be useful to be able to run dbx destroy so that all jobs defined in the YAML config file are deleted from Databricks.

ilyasotkov avatar Mar 28 '22 12:03 ilyasotkov

I agree. dbx uploads artifacts and deploys jobs. It would be helpful if dbx could delete everything related to a job (the job itself, artifacts and experiments).

scheleaap avatar Apr 27 '22 12:04 scheleaap

It would be also great if this command was also run to keep the API job resources aligned with the jobs defined in the deployment.yml. For example, say I remove a job with the intention of no longer running that job in a given databricks workspace. Is this also considered in this work?

kennes913 avatar May 10 '22 16:05 kennes913