airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Add datasets to dag graph

Open bbovenzi opened this issue 1 year ago • 0 comments

Add datasets as upstream and downstream nodes in the DAG graph.

Make it easier to visualize what a DAG is connected to. And provide a tooltip to jump over to that dataset to see what else it connects to. This makes it easier to jump back and forth between dag view and a dataset view.

Screenshot 2024-02-21 at 3 10 42 PM

Zoomed out: Screenshot 2024-02-21 at 3 10 16 PM

After this:

  • we could add the relevant dataset events to a Dataset node too. Perhaps even in both the dataset and dag graphs and we can share the node components between the two graphs.
  • We can add trigger rules to the tooltip for dataset-and-timetable or any/all conditions

^ Add meaningful description above Read the Pull Request Guidelines for more information. In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed. In case of a new dependency, check compliance with the ASF 3rd Party License Policy. In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

bbovenzi avatar Feb 21 '24 20:02 bbovenzi