Improvements to the UI for 3.0

[1cadumagalhaes]

Description

Helllo! I've been using 3.0 and gathered some small things to implement to the UI, and just thought I should open an issue to track them in case other people have suggestions, or to know if any of these is being worked at. My idea is to work on this in the next couple weeks.

• [ ] Missing Configurations page in the navbar. On 2.10 it was under admin when exposed ([api].expose_config=true). The page already exists, there's just no entry in the navbar (/configs)
• [x] Missing Test connection button in the connections form. ([core].test_connection=Enabled) (edit: added in the connections page on #51055. Not sure its also on the new connection form)
• [ ] Tooltips + legend for task status in dag page. (the new icons are great, but I do miss some legend)
• [ ] Tasks/taskgroups order on grid view are weird. On 2.x they're mostly ordered. On 3.0 they look random to me (maybe I'm doing something wrong? not sure)
• [ ] 404 page (just testing what pages are available, when I go to an invalid one it just renders a blank page. i.e. /cluster_activity).

Some other things that I think would require more work

• [ ] Create a user profile/user info page.
• [ ] DAG page: run duration, task duration, calendar and gant views.
• [ ] Dependency graph for assets
• [ ] Migrate pages under security (I assume they're just embeding the pages from 2.x)
• [ ] Hability to select groups in DAG page and mark their status as success/failed

Use case/motivation

No response

Related issues

No response

Are you willing to submit a PR?

• [x] Yes I am willing to submit a PR!

Code of Conduct

• [x] I agree to follow this project's Code of Conduct

[tirkarthi]

Test connection was implemented in https://github.com/apache/airflow/pull/51055 .

[1cadumagalhaes]

Test connection was implemented in #51055 .

Thanks @tirkarthi , I've only checked opened issues but I've not checked the PRs. I'll take a look to see if there's anything else

[1cadumagalhaes]

Here's one example of the "order" issue in the grid view:

[tagoad]

I second the ability to clear/set status of groups. This is actually holding us back from upgrading to 3.0 because we use that functionality a lot and without management of our deployments is going to be annoying. Another feature I miss is being able to delete DAGs, especially when I am developing locally.

[bbovenzi]

Thanks for the feedback!

• I see the configurations page. What am I missing here?

• Could you elaborate on what you'd like so see on a user profile page? We don't actually have a user object in the DB to pull settings from

• What do you see as missing in the Asset Dependency graph?

• We probably won't migrate the security pages. Those are specific to the FAB Auth Manager which is now fully separate from the UI. Other auth managers don't have a specific UI, or will be able to use plugins in 3.1+. The FAB security page is already a pseudo-plugin, we might move it to be a real plugin.

[FelipeRamos-neuro]

Hi @1cadumagalhaes, could you take a look at this discussion that I opened on May about the UI? https://github.com/apache/airflow/discussions/50492

Maybe some of the topics could serve as inspiration to turn into UI improvements as well

[1cadumagalhaes]

hey @bbovenzi

I see the configurations page. What am I missing here?

For me there is no entry on the navbar:

And I know its enabled because when it isnt I cant access the path /configs

About the rest: to be honest I was just nitpicking/comparing with previous version.

Could you elaborate on what you'd like so see on a user profile page?

For me, one important thing about the user profile page is to give the option to the user to reset their password or simple info like first and last name. But also just letting the user know their role I guess

What do you see as missing in the Asset Dependency graph?

I mean, I cant find one. Is there an asset dependency graph? I know there is a list of assets, and they all have group, consuming dags and producing tasks

Also, a friend of mine complained about the performance of the grid view, saying that in a dag with a few hundred tasks it just broke the webserver. I dont have any dag so large so I did not have that issue.

@FelipeRamos-neuro , I agree. For me, the graph view is complementary to the grid view, not a substitution. And its related to what I've mentioned initially about gant and calendar views.

And @tagoad I think I just forgot to mention that. I thought about deleting dag runs or task runs. But I can understand the decision of removing them.

[bbovenzi]

1. check your network tab for the response from /ui/auth/menus and see if the config page exists there
2. Password and perimissions is something that depends on your auth manager. That is not something that the Airflow UI manages itself.
3. We removed the Dag Dependency view that just shows everything at once. You need to select a single Dag or a single Asset to see a graph of what it is connected to
4. We're working on the grid view performance
5. I explain the rationale about grid/graph here: https://github.com/apache/airflow/discussions/50492#discussioncomment-13555140
6. We already added Dag, Run, and TI deletion bulk actions. Anything that's missing should come out in 3.1

[bbovenzi]

This thread is getting a bit unwieldy. Could you please open separate issues for each bug/feature? And then we can close this one.