Flexible node selection in `kedro run` command line syntax
Description
I would like to be able to run nodes across namespaces in a more flexible way.
Context
Let's say I have three identical nodes across three namespaces: red.node, blue.node, yellow.node.
If I want to run them all, my only option is: kedro run --nodes red.node,blue.node,yellow.node
As number of namespaces increase this gets unweildy.
Possible Implementation
Add bash-style or dataset factory style wildcarding to the run command:
-
kedro run --nodes "*.node" - Or
kedro run --nodes "{namespace}.node"
Possible Alternatives
Suggestion from @datajoely:
DBT style syntax for inclusion / exclusion / etc: https://docs.getdbt.com/reference/node-selection/syntax
Related - https://github.com/kedro-org/kedro/issues/2552
Is this related too? #3679
@ianwhale thank you for the issue submitted! We would like to add this ticket to our backlog and investigate how exactly we want to extend run command filtering interface given the related issues mentioned above.