Jonathan Lee
Jonathan Lee
I'd like your thoughts on this change @jgraham. According to the blame, I think you're the expert on the test metadata format? For some context, we're building a CLI frontend...
Looks like a new test (`/css/css-masking/clip-path/animations/two-clip-path-animation-diff-length2.html`) mostly fails in Firefox. Will retry the stability check.
A new test is flaky in Firefox: **WPT Command:** `python3 ./wpt run --channel=nightly --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox`...
Bug for the new test: crbug.com/1353567 @DanielRyanSmith @KyleJu Please merge. Thanks!
Retrying CI. At least some of the failures should be fixed after #36003. Not sure about the Firefox stability ones.
**WPT Command:** `python3 ./wpt run --channel=nightly --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --binary=/home/test/build/firefox/firefox firefox` Some affected tests had slow results: ##...
@KyleJu @DanielRyanSmith These are existing flakes. I've pinged a bug thread (crbug.com/1348696#c10). Please merge, thanks!
> (also I note that wpt-update already exists for updating the metadata; are you using that or something else? We use it for Gecko and it seems to work OK,...
> is it possible in the overloaded TestLoader we load tests directly from tests we want to run? I don't think that addresses the main constraint, which is that we...
Right, this only addresses (2), which creates per-subsuite overhead and therefore was not noticeable before subsuites landed. (1) is less urgent because its overhead is fixed. The `manifest/*` changes are...