webstatus.dev icon indicating copy to clipboard operation
webstatus.dev copied to clipboard

No WPT scores shown for content-visibility and view transitions

Open foolip opened this issue 1 year ago • 2 comments

https://webstatus.dev/features/view-transitions shows numbers in the graph, but no scores in the summary boxes. Also no scores in https://webstatus.dev/?q=view-transitions.

https://wpt.fyi/results/?label=master&label=experimental&aligned&q=feature%3Aview-transitions works.

@jcscottiii can you check what's happening here?

foolip avatar May 21 '24 18:05 foolip

It looks like exactly the same thing is happening with https://webstatus.dev/features/content-visibility.

foolip avatar May 21 '24 18:05 foolip

Notes for myself:

view-transitions data:

{
  "baseline": {
    "status": "limited"
  },
  "browser_implementations": {
    "chrome": {
      "date": "2023-03-07",
      "status": "available"
    },
    "edge": {
      "date": "2023-03-13",
      "status": "available"
    }
  },
  "feature_id": "view-transitions",
  "name": "View transitions",
  "spec": {
    "links": [
      {
        "link": "https://drafts.csswg.org/css-view-transitions-1/"
      }
    ]
  },
  "wpt": {
    "experimental": {
      "chrome": {
        "score": 0.948051948
      },
      "edge": {
        "score": 0.866133866
      },
      "firefox": {
        "score": 0.385614386
      },
      "safari": {
        "score": 0
      }
    },
    "stable": {
      "firefox": {
        "score": 0.385614386
      },
      "safari": {
        "score": 0.37962038
      }
    }
  }
}

content-visibility data:

{
  "baseline": {
    "status": "limited"
  },
  "browser_implementations": {
    "chrome": {
      "date": "2022-11-29",
      "status": "available"
    },
    "edge": {
      "date": "2022-12-05",
      "status": "available"
    }
  },
  "feature_id": "content-visibility",
  "name": "content-visibility",
  "spec": {
    "links": [
      {
        "link": "https://drafts.csswg.org/css-contain-2/#content-visibility"
      }
    ]
  },
  "wpt": {
    "experimental": {
      "chrome": {
        "score": 0.969339623
      },
      "edge": {
        "score": 0.952830189
      },
      "firefox": {
        "score": 0.964622642
      },
      "safari": {
        "score": 0.95754717
      }
    },
    "stable": {
      "firefox": {
        "score": 0.950471698
      },
      "safari": {
        "score": 0.382075472
      }
    }
  }
}

Analysis

In both cases, Firefox and Safari do not show up as intended because they currently do not have a browser implementation status.

Edge and Chrome do not show up because their latest runs did not succeed.

For view-transitions, here's the crash.

For content-visibility, here's the crash

Currently, we disregard the results for subtest count if there's a subtest with a crash. This is because the number of subtests can be wrong.

The endpoint that returns the score for the summary boxes looks at the latest run. Not the latest run that did not crash (which could be N runs before)

jcscottiii avatar May 21 '24 20:05 jcscottiii

Now that the browsers with implementation statuses have appeared (Edge and Chrome), we see the info for them. We continue to not show the other browsers because their implementation status is missing.

I will close this issue.

Let me know if we should:

  • Improve the UX to let users know that the score isn't showing that reason (create a new issue)
  • Store the latest non crashed feature metrics to prevent the need to go back N runs to find it. (comment on #382 as that could influence that implementation with the new LatestMetrics table)

jcscottiii avatar Jun 27 '24 19:06 jcscottiii