rportilla-databricks

Standardize parameter names

1

For example, the asofJoin parameters do not follow the same convention. Fix this across the project.

Improve AS OF Join Performance through Max Lookback parameter

1

Currently, AS OF joins require a window to be retained in memory per partition key (key for the Spark window). Improve may benefit from only looking back a certain number...

Newest guide here, which we will incorporate with PSC.

Add Databricks Overwatch for Observability

1

We should consider adding overwatch as part of the setup with a default of 'off'. The final decision on whether to add this needs to consider the setup cost and...

Today, we have an AWS example showing how to compose `aws_base` (Databricks-compliant VPC), `aws_customer_managed_vpc`, `aws_full_governed_ws` (Unity catalog integration) and `aws_fs_lakehouse`, a layer with some industry libs, jobs, and notebooks. For...

Having an NSG-based deployment structure can be beneficial to use repeatable configurations and apply least privilege controls. This issue should be considered complete when the module is importable into the...

[ISSUE] Ensure Python SDK U2M authentication functions on Windows

1

Description This is to track running Python tests on Windows in CI Reproduction https://github.com/databricks/databricks-sdk-java/pull/192 - an issue previously existed in the Java SDK so we want to ensure we have...

Added export CLI functionality for assessment results

1

## Changes * Update project to include `export` CLI function * Added notebook utility to run the export from the workspace environment * Added default location, unit tests, and integration...