dbx
dbx copied to clipboard
no support for docker_image option for creating clusters
trafficstars
Expected Behavior
- ability to specify docker image to use from deployment.yaml for dbx
- feature parity w/ terraform provider: https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/cluster#docker_image
Current Behavior
missing support for specifying docker image to use via dbx deployment.yaml
Steps to Reproduce (for bugs)
- follow code path for handling job_clusters options
- underlying class has no option mentioning docker or containers: https://github.com/databrickslabs/dbx/blob/34bd186956915d70792621faa1a8bc38f38a9d41/dbx/models/workflow/common/new_cluster.py#L36-L46
Context
We are specifically looking for ECR support
Your Environment
- dbx version used: v0.8.18 (inspected code in main while this was the latest version)
- Databricks Runtime version: n/a