wpt.fyi icon indicating copy to clipboard operation
wpt.fyi copied to clipboard

Store screenshots for references even when passing

Open foolip opened this issue 4 years ago • 2 comments

https://github.com/web-platform-tests/wpt.fyi/issues/57 introduced screenshots for the actual and expected rendering for failing reftests.

Sometimes, to understand a failure in one browser it would be handy to know how the test passed in other browsers. Such a case I'm looking at today: https://wpt.fyi/results/css/css-flexbox/gap-006-ltr.html?run_id=717360002&run_id=709260001&run_id=746070001

I suspect that the problem is with the ref and and not the test, and being able to see what the actual rendering was in Chrome and Firefox would have been helpful. Normally actual and expected are the same, but in the case of fuzzy matching it might be necessary to store both.

@Hexcles

foolip avatar Oct 29 '20 11:10 foolip

I filed this because it would have come in handy for https://github.com/web-platform-tests/wpt/issues/26326.

foolip avatar Oct 29 '20 11:10 foolip

This would have come in handy for https://github.com/web-platform-tests/wpt/pull/45073 again. When there's an interop issue revealed by a reftest, it's useful to see what the passing browsers do.

@past FYI, as this is an old issue I'm bumping.

foolip avatar Mar 13 '24 11:03 foolip