lighthouse-ci icon indicating copy to clipboard operation
lighthouse-ci copied to clipboard

Category summary chart doesn't match up with data

Open paulirish opened this issue 4 years ago • 1 comments

I'm seeing a dip in the chart I can't find in the reports or diffs.

image

To Reproduce Steps to reproduce the behavior:

  1. Go to http://lhci-canary.herokuapp.com/app/projects/d1e4b15c-e644-4552-b136-e975f486a2ce/dashboard (web.dev's dashboard)
  2. Click on 50 for most recent 50 commits. (might need to be 100 in a week if web.dev keeps landing commits ;)
  3. See the -9 drop in perf score.
  4. Try to find the report that shows a perf score of 89.

clicking on "CI diff" brings us here which has no change in the 98 score.


btw I'm happy to investigate this further if I can get some direction on where to go from here. :)

paulirish avatar Feb 25 '21 02:02 paulirish

Hm yeah I can reproduce this too. Seems like there was a difference in the median stat compared to the representative run?

That would expectedly produce this result and would need https://github.com/GoogleChrome/lighthouse-ci/issues/235 to resolve. You could manually query the available runs at the API to look into it?

patrickhulce avatar Feb 25 '21 03:02 patrickhulce