cli icon indicating copy to clipboard operation
cli copied to clipboard

[Feature Request] Add support for SQL Warehouse in DAB

Open hariaculeti opened this issue 9 months ago • 5 comments

Describe the issue

Unable to create new sql warehouse in DAB

Configuration

not needed

Steps to reproduce the behavior

Could you please let me know the roadmap on when sql warehouse is added in DAB?

Expected Behavior

Expect DAB to support all terraform modules. We are in the process of moving away from Terraform to DAB and expect all the TF module blocks to be available in DAB

Actual Behavior

not needed

OS and CLI version

Databricks CLI v0.236.0

Is this a regression?

not needed

Debug Logs

not needed

hariaculeti avatar Feb 24 '25 07:02 hariaculeti

Please add warehouse and permissions to DAB

hariaculeti avatar Feb 24 '25 21:02 hariaculeti

@andrewnester .. could you please let me know the approximate ETA for this feature to be available so that we can plan accordingly.. Thanks

hariaculeti avatar Feb 28 '25 03:02 hariaculeti

@hariaculeti this is not yet on our roadmap unfortunately so no ETA, we might consider it for Q2, so I will keep this issue updated with any progress

andrewnester avatar Feb 28 '25 09:02 andrewnester

Would like to see this as well.

haveyoumetcp avatar Mar 04 '25 19:03 haveyoumetcp

Same here, it would be really nice to be able to create SQL warehouses in bundles.

miguelCalado avatar Mar 25 '25 00:03 miguelCalado

This issue has not received a response in a while. If you want to keep this issue open, please leave a comment below and auto-close will be canceled.

github-actions[bot] avatar May 24 '25 00:05 github-actions[bot]

Still want this

haveyoumetcp avatar May 24 '25 00:05 haveyoumetcp

@andrewnester .. any update on this request please?

hariaculeti avatar May 24 '25 03:05 hariaculeti

would be nice to have this added!

goda avatar May 30 '25 13:05 goda

In addition to creating a warehouse, it would be beneficial to be able to look up the warehouse ID later on (like we can with cluster lookup).

ksummerlin avatar Jun 09 '25 23:06 ksummerlin

@ksummerlin It is possible to look up a warehouse ID if one exists today, see the docs or this example.

pietern avatar Jun 16 '25 07:06 pietern

SQL warehouse support was just added in 0.260.0 CLI release, please give it a try https://github.com/databricks/cli/releases/tag/v0.260.0

andrewnester avatar Jul 16 '25 16:07 andrewnester

@andrewnester Thanks for looking into this. I am able to deploy the warehouse but I am unable to provide permissions. Can you check if permissions are added to warehouses? If yes, please provide an example

hariaculeti avatar Jul 17 '25 04:07 hariaculeti

@andrewnester .. do you want to reopen the issue or should I raise new issue for permissions? Please confirm.

hariaculeti avatar Jul 21 '25 03:07 hariaculeti

@hariaculeti yes, permissions should be set using this configuration as an example

resources:
  sql_warehouses:
    test_sql_warehouse:
      name: sql_warehouse_name
      cluster_size: X-Large
      enable_serverless_compute: true
      max_num_clusters: 1
      min_num_clusters: 1
      auto_stop_mins: 120
      permissions:
        - group_name: "users"
          level: "CAN_USE"
        - group_name: "viewers"
          level: "CAN_VIEW"

You can see details here https://github.com/databricks/cli/pull/3280

Do you receive specific type of error?

andrewnester avatar Jul 21 '25 10:07 andrewnester

@andrewnester I was having typo in permissions (was using privileges instead of level) and that was causing issue. Its working beautifully now. Thanks a lot for your help.

hariaculeti avatar Jul 21 '25 11:07 hariaculeti