results-collection icon indicating copy to clipboard operation
results-collection copied to clipboard

Published 20 hours ago • verified publisher icon web-platform-tests

Edge test results are different on local machine

Open beaufortfrancois opened this issue 6 years ago • 1 comments

Picture-in-Picture idlharness.window.html Edge tests are different when running locally and in wpt dashboard.

There are 36 test results in https://wpt.fyi/results/picture-in-picture/idlharness.window.html?label=experimental&product=edge while there are 42 locally (using BrowserStack)

screenshot 2018-10-18 at 11 15 28 am

Note that there should 43 tests running. Missing tests seem to be related to EnterPictureInPictureEvent: https://wpt.fyi/results/picture-in-picture?label=experimental&products=chrome,edge

beaufortfrancois avatar Oct 18 '18 09:10 beaufortfrancois

FWIW, I see the same results as in that screenshot when testing Edge Insider Preview.

https://wpt.fyi/results/picture-in-picture/idlharness.window.html?label=experimental&product=edge is by now a fairly old run, so perhaps there have been changes in wpt itself in the interim that explain the different numbers. @thejohnjansen do you plan to upload a new round of results for Edge Insider Preview soon, so we could see if this problem has been resolved?

foolip avatar Oct 18 '18 12:10 foolip