Filtering of subtests can make understanding results harder

[foolip]

Repro steps:

• Start at https://staging.wpt.fyi/results/?diff&filter=ADC&run_id=256970019&run_id=253050003
• Add seq(status:ok status:!ok) to search
• Drill down to content-security-policy/inheritance/window.html

You will be at https://staging.wpt.fyi/results/content-security-policy/inheritance/window.html?diff&filter=ADC&q=seq%28status%3Aok%20status%3A%21ok%29&run_id=256970019&run_id=253050003, showing this:

With only the harness status showing, there's no clues about what went wrong with this test. It's necessary to remove the filter to see all subtests, to understand that the first subtest to time out was "window.open('blob:...') inherits policy" and probably that's where the problem is.

Triaging failures quickly will be difficult when one has to add/remove the search filter for each test.

Graying out items which aren't matched by the filter and collapsing many consecutive ones might help, or the ability to quickly toggle the filtering.

[foolip]

@stephenmcgruer I seem to remember you doing or suggesting something about this recently, but I can't find where that was. Am I misremembering?

[stephenmcgruer]

I was playing around with a button that basically says 'ignore my search filter', but never got further than a mock-up. (No time!). So there's no prior art here currently.

[foolip]

I see, and I'm glad I wasn't imagining things 😄