brickflow icon indicating copy to clipboard operation
brickflow copied to clipboard

[BUG] `-w` option from `bf projects deploy` is missing in version 0.10 and up

Open emulanob opened this issue 2 years ago • 5 comments

Describe the bug Since version 0.10.0 the command bf projects deploy doesn't have the -w flag used to specify a single workflow name. It's also not mentioned in the docs.

To Reproduce Steps to reproduce the behavior:

  1. bf projects deploy -w myworkflow.py
Error: No such option: -w

Expected behavior Should deploy that single workflow "myworkflow.py"

emulanob avatar Sep 19 '23 15:09 emulanob

We want to enable this option only for: --env local.

If there are 3 workflows already existing in the Databricks remote, then if we use -w and deploy a new workflow - we are anticipating that the 3 workflows which were already deployed should not be deleted.

asingamaneni avatar Nov 16 '23 22:11 asingamaneni

Hey @asingamaneni, I agree with your assessment. The use case I had in mind was local testing/CICD. Instead of deploying all of my workflows, only one would suffice.

emulanob avatar Nov 17 '23 10:11 emulanob

@asingamaneni I also have a CI/CD use case for the -w and -wd options as mentioned on Slack.

We want to enable this option only for: --env local.>

Is above a hard requirement as we would need to deploy a single workflow to our different environments in this CI/CD use case ... ?

BrendBraeckmans avatar Nov 20 '23 14:11 BrendBraeckmans

We would not want to deploy single workflows via CI/CD as that would require us to maintain and manage the state other than what DAB provides us. Want this option only for local, as we wouldn't want engineers to deploy all the workflows which have schedule and increase the cost.

asingamaneni avatar Nov 20 '23 15:11 asingamaneni

Ok clear we'll find a way to achieve what we need with only the local env deploy. Thanks for the clear and swift reply :)

BrendBraeckmans avatar Nov 20 '23 15:11 BrendBraeckmans