wpt-metadata icon indicating copy to clipboard operation
wpt-metadata copied to clipboard

Clean up fixed bugs for passing tests

Open foolip opened this issue 4 years ago • 4 comments

https://wpt.fyi/results/css/css-transforms?label=experimental&label=master&aligned now shows a bunch of bug icons for tests that are passing: image

This is not great when trying to look through failures and their bugs, it's basically adding visual noise.

@KyleJu do you think this could be cleaned up in wpt-metadata, or would it make more sense to fix it in wpt.fyi by not showing the icon for green cells?

foolip avatar Aug 25 '21 10:08 foolip

Another category of cleanup is bugs that are closed but the failures remain. Those need re-triage.

foolip avatar Aug 25 '21 10:08 foolip

@KyleJu do you have any thoughts about how this could be implemented?

foolip avatar Sep 08 '21 07:09 foolip

I keep removing closed bugs manually with PRs like these:

  • https://github.com/web-platform-tests/wpt-metadata/pull/3260
  • https://github.com/web-platform-tests/wpt-metadata/pull/3806
  • https://github.com/web-platform-tests/wpt-metadata/pull/4077
  • https://github.com/web-platform-tests/wpt-metadata/pull/4122
  • https://github.com/web-platform-tests/wpt-metadata/pull/4779
  • https://github.com/web-platform-tests/wpt-metadata/pull/4785
  • https://github.com/web-platform-tests/wpt-metadata/pull/4791
  • https://github.com/web-platform-tests/wpt-metadata/pull/4874
  • https://github.com/web-platform-tests/wpt-metadata/pull/4916
  • https://github.com/web-platform-tests/wpt-metadata/pull/4943

Since I just apply a mechanical rule of "test is passing in stable and experimental and bug is closed" this could be automated.

@past can you consider this for future planning? It would make it easier to keep the triage of Interop 202X failures up-to-date.

foolip avatar Oct 25 '23 06:10 foolip

Agreed that this would be nice to have, I added it to our backlog.

past avatar Nov 03 '23 16:11 past