kedro
kedro copied to clipboard
Flexible node selection in `kedro run` command line syntax
Description
I would like to be able to run nodes across namespaces in a more flexible way.
Context
Let's say I have three identical nodes across three namespaces: red.node
, blue.node
, yellow.node
.
If I want to run them all, my only option is: kedro run --nodes red.node,blue.node,yellow.node
As number of namespaces increase this gets unweildy.
Possible Implementation
Add bash-style or dataset factory style wildcarding to the run command:
-
kedro run --nodes "*.node"
- Or
kedro run --nodes "{namespace}.node"
Possible Alternatives
Suggestion from @datajoely:
DBT style syntax for inclusion / exclusion / etc: https://docs.getdbt.com/reference/node-selection/syntax