kedro icon indicating copy to clipboard operation
kedro copied to clipboard

Flexible node selection in `kedro run` command line syntax

Open ianwhale opened this issue 3 weeks ago • 2 comments

Description

I would like to be able to run nodes across namespaces in a more flexible way.

Context

Let's say I have three identical nodes across three namespaces: red.node, blue.node, yellow.node.

If I want to run them all, my only option is: kedro run --nodes red.node,blue.node,yellow.node

As number of namespaces increase this gets unweildy.

Possible Implementation

Add bash-style or dataset factory style wildcarding to the run command:

  • kedro run --nodes "*.node"
  • Or kedro run --nodes "{namespace}.node"

Possible Alternatives

Suggestion from @datajoely:

DBT style syntax for inclusion / exclusion / etc: https://docs.getdbt.com/reference/node-selection/syntax

ianwhale avatar Jun 12 '24 12:06 ianwhale