cli icon indicating copy to clipboard operation
cli copied to clipboard

Add setup for DBR testing

Open shreyas-goenka opened this issue 3 months ago β€’ 1 comments

Changes

This PR adds a notebook we can use to easily run and iterate on DBR tests.

Why

Simplifies the test setup and makes it easy to debug issues with the DBR testing framework itself. You just have to run make dbr_scratch to get started.

shreyas-goenka avatar Sep 07 '25 22:09 shreyas-goenka

Run: 18380840675

Env πŸ”„β€‹flaky βœ…β€‹pass πŸ™ˆβ€‹skip
πŸ”„β€‹ aws linux 1 323 544
βœ…β€‹ aws windows 325 543
πŸ”„β€‹ aws-ucws linux 9 431 440
πŸ”„β€‹ aws-ucws windows 9 432 439
βœ…β€‹ azure linux 324 543
βœ…β€‹ azure windows 325 542
πŸ”„β€‹ azure-ucws linux 9 431 439
πŸ”„β€‹ azure-ucws windows 9 432 438
πŸ”„β€‹ gcp linux 1 322 545
βœ…β€‹ gcp windows 324 544
14 failing tests:
Test Name aws linux aws-ucws linux aws-ucws windows azure-ucws linux azure-ucws windows gcp linux
TestAccept/bundle/deploy/dashboard/detect-change βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p βœ…β€‹p
TestAccept/bundle/deploy/dashboard/generate_inplace βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p
TestAccept/bundle/deploy/dashboard/nested-folders βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p βœ…β€‹p
TestAccept/bundle/deploy/dashboard/simple βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p
TestAccept/bundle/deploy/dashboard/simple_outside_bundle_root βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p
TestAccept/bundle/deploy/dashboard/simple_syncroot βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p
TestAccept/bundle/deploy/registered_models/basic πŸ™ˆβ€‹s βœ…β€‹p βœ…β€‹p βœ…β€‹p πŸ”„β€‹f πŸ™ˆβ€‹s
TestAccept/bundle/deploy/registered_models/basic/DATABRICKS_BUNDLE_ENGINE=direct-exp βœ…β€‹p βœ…β€‹p βœ…β€‹p πŸ”„β€‹f
TestAccept/bundle/deployment/bind/dashboard βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p βœ…β€‹p
TestAccept/bundle/deployment/bind/dashboard/recreation βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p βœ…β€‹p
TestSetupDbrRunner πŸ”„β€‹f βœ…β€‹p βœ…β€‹p βœ…β€‹p βœ…β€‹p πŸ”„β€‹f
TestDashboardAssumptions_WorkspaceImport βœ…β€‹p πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f πŸ”„β€‹f βœ…β€‹p
TestFilerWorkspaceNotebook βœ…β€‹p βœ…β€‹p βœ…β€‹p βœ…β€‹p πŸ”„β€‹f βœ…β€‹p
TestFilerWorkspaceNotebook/rNb.r βœ…β€‹p βœ…β€‹p βœ…β€‹p βœ…β€‹p πŸ”„β€‹f βœ…β€‹p

eng-dev-ecosystem-bot avatar Sep 07 '25 22:09 eng-dev-ecosystem-bot