[Feature Request] Modular DAG

[GhisF]

It is not uncommon to have several versions of a DAG with only minor variations. It could be interesting to have the possibility to import steps or call other DAGs to avoid copy/paste between dags.

[yohamta]

Thanks for the great suggestion. Yes, as you mentioned there're two different approaches to dealing with the issue. I think calling other DAGs (or sub-DAGs) natively looks like a good idea.

[ccxuy]

any updates?

[yohamta]

Not yet. While importing steps or calling other DAGs to avoid copy/paste between DAGs is an interesting idea, I think that allowing the direct importing of other DAGs in YAML could lead to some complications and potential issues with maintainability.

As an alternative, you can currently call other DAGs (or sub-DAGs) using the dagu start command.

We can continue to explore ways to improve the reusability and modularity of DAGs. Any suggestion or ideas are very welcomed.

[yohamta]

my idea:

steps:
  - sub_workflow1
     run: path/to/sub_workflow.yaml
     params: "A=1 B=2"

[GhisF]

It looks like a good idea.

[yohamta]

This feature is implemented in v1.13.0.