wpt.fyi
wpt.fyi copied to clipboard
Document where the results come from
@reillyeon asked me:
can you share a link to where the infrastructure that runs wpt.fyi is documented? I get questions from developers about how it is different from our internal CI so it would be nice to have an authoritative source.
Unfortunately I don't think this exists, but it's a good idea. The short answer is:
- Chrome, Firefox, Servo and WebKitGTK results come from the Taskcluster setup
- Edge and Safari results come from Azure Pipelines
https://web-platform-tests.org/running-tests/from-ci.html mentions .azure-pipelines.yml and .taskcluster.yml so someone very curious might be able to figure it out from there, but it's very hard to answer questions like:
- How often do we run?
- Which channels and versions do we run?
- Why is the version stuck?
Documenting this on https://wpt.fyi/about directly would be great. That could link out to other bits of documentation, but it would be great if that were the starting point.
@KyleJu WDYT?
Yea documenting it on https://wpt.fyi/about directly would work unless we create a dedicated tab? Hyperlinking .azure-pipelines.yml and .taskcluster.ym would make things clear.
I think the about page should be fine, that's where I would look at least, and there's not too much other information on the page already.
In addition to linking the CI configurations, we should probably say something about how often we run and which versions we run. But with a caveat that the linked configuration is the source of truth, and that if something seems wrong the place to file issues is in wpt.