dbx icon indicating copy to clipboard operation
dbx copied to clipboard

no support for docker_image option for creating clusters

Open tplass-ias opened this issue 2 years ago • 0 comments
trafficstars

Expected Behavior

  • ability to specify docker image to use from deployment.yaml for dbx
  • feature parity w/ terraform provider: https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/cluster#docker_image

Current Behavior

missing support for specifying docker image to use via dbx deployment.yaml

Steps to Reproduce (for bugs)

  1. follow code path for handling job_clusters options
  2. underlying class has no option mentioning docker or containers: https://github.com/databrickslabs/dbx/blob/34bd186956915d70792621faa1a8bc38f38a9d41/dbx/models/workflow/common/new_cluster.py#L36-L46

Context

We are specifically looking for ECR support

Your Environment

  • dbx version used: v0.8.18 (inspected code in main while this was the latest version)
  • Databricks Runtime version: n/a

tplass-ias avatar Jul 14 '23 18:07 tplass-ias