wpt.fyi
wpt.fyi copied to clipboard
web-platform-tests
Feature: "Report issue with data"
Occasionally, visitors to wpt.fyi identify patterns in the datasets which indicate problems with the results collection process. They may file an issue against this project under the assumption that the results collection code is maintained here. Although today, this small mistake does not lead to much inefficiency (and may be partially mitigated by carefully placed documentation), I think it may become more confusing as more independent projects begin contributing results.
The results receiver already supports the concept of an "uploader"--an account with a name and password. If this were extended with a "contact" e-mail address and (where possible) a "report issue" URL, then wpt.fyi could provide more direct assistance to those who want to improve the results.
In a future iteration, we could use this same data to showcase the collaborative nature of the project. Text like, "the following teams have contributed results in the past month: [...]" would give all involved a warm and fuzzy feeling about their participation.
As mentioned in gh-534, if we were to perform data validation asynchronously, this information could also be used to notify uploaders of any issues.
I think the first phase here is to have a point-of-contact for the runs, or at least a issue-filing template?
This request is UI for a part of the lifecycle project for the results receiver, which will eventually include a validation step.