results-analysis icon indicating copy to clipboard operation
results-analysis copied to clipboard

Shorten time between results and metrics generation

Open foolip opened this issue 3 years ago • 4 comments

As discussed in https://github.com/Ecosystem-Infra/wpt-results-analysis/issues/63 there are a few different scheduled jobs in the pipeline between results submitted to wpt.fyi and the metrics being generated and used on https://wpt.fyi/interop-2022. We could shorten this time.

foolip avatar Mar 08 '22 12:03 foolip

Now we're regenerating all the data from scratch each time, is there any reason not to do it more frequently, and just accept the latest number (for the current day or two) can change over time, as we get more runs?

gsnedders avatar Mar 14 '22 17:03 gsnedders

No, I think we should change it to calculate metrics for as recent as there is data.

foolip avatar Apr 08 '22 15:04 foolip

With #80 having landed, I think we're at max 4h latency: 1h because the https://github.com/web-platform-tests/results-analysis-cache is updated hourly, then 3h because this is only updated every three hours.

gsnedders avatar Apr 09 '22 00:04 gsnedders

Reopening because #81 reverted that.

gsnedders avatar Apr 09 '22 00:04 gsnedders