dbx
dbx copied to clipboard
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
## Expected Behavior Execute code from https://dbx.readthedocs.io/en/latest/guides/python/python_quickstart/ works. ## Current Behavior When running `pytest tests/unit --cov` there is an exception: **_AttributeError: 'DataFrame' object has no attribute 'iteritems'_** ## Steps to...
## Expected Behavior Provide an option to upload (and use) cluster init-scripts to the workspace via `deployment.yaml`. Storing them in dbfs is deprecated (see https://docs.databricks.com/api/azure/workspace/clusters/create). ## Current Behavior It is...
## Expected Behavior When defining an Alert SQL task through the deployment.yml like this: ``` environments: default: workflows: - name: "alert-job" - task_key: "alert_task" sql_task: alert: alert_id: "alert://alert1" warehouse_id: "warehouse://sql-warehouse"...
Since the `--requirement-file` option was deprecated, there is now no supported way to supply additional library dependencies to `dbx deploy`. However, these are crucial for jobs like integration tests, where...
## Expected Behavior Integration test should run successfully ## Current Behavior Integration test fails with: ``` --------------------------------------------------------------------------- ModuleNotFoundError Traceback (most recent call last) in () 1 import sys 2 ---->...
## Expected Behavior I expect to be able to specify paths for notebooks in the artifact directory. ``` notebook_task: notebook_path: "file://path/in/artifact/directory/notebook.py" ``` ## Current Behavior The above line breaks with...
## Expected Behavior Using `dbx launch` with the same arguments as `dbx deploy` should launch the defined workflows. ## Current Behavior To launch a workflow I have to provide the...
## Expected Behavior - ability to specify docker image to use from deployment.yaml for dbx - feature parity w/ terraform provider: https://registry.terraform.io/providers/databricks/databricks/latest/docs/resources/cluster#docker_image ## Current Behavior missing support for specifying docker...
## Expected Behavior Make the `dbx sync dbfs` respects the same standard variables as the `databricks-cli` and make it consistent with its own [tutorial](https://docs.databricks.com/dev-tools/dbx-sync.html) describing usage of `DATABRICKS_HOST` and `DATABRICKS_TOKEN`...
## Expected Behavior Using the DLT pipeline deployment file as a template, I should be able to fill in appropriate values and deploy the pipeline successfully. ## Current Behavior Trying...