sdk icon indicating copy to clipboard operation
sdk copied to clipboard

Tracking: External ecosystem preparedness for sound null safety

Open nuritzi opened this issue 3 years ago • 6 comments

Goal: We'd like to track progress on the % of flutter run sessions that are fully sound. This will help us track progress towards our next Dart major version.

Frequency: we'd like to pull these stats on a weekly basis.

How to

Here's the analytics query; must manually adjust end-date of query

Todos

  • [ ] Measure: % of flutter run sessions that are fully sound
  • [ ] Document how you pulled this information (can be in a doc or in this issue).
  • [ ] Automate a weekly report if possible.

nuritzi avatar Aug 29 '22 10:08 nuritzi

@devoncarew would you be able to help with this issue, or is there someone else on the ecosystem who can?

nuritzi avatar Aug 29 '22 10:08 nuritzi

Given that we're already tracking the data and have a query to measure what we want, I see two reasonable solutions here:

  1. manually check in on the % of flutter run sessions every week; populate that info in a spreadsheet for historical data
  2. use a PLX dashboard to query the analytics data and populate an automated dashboard

I suspect that 1. is something that TPgM would drive. For 2., @jayoung-lee (on the UXR team) has lots of PLX experience and could help set this up. Given the shorter timeframe we care about this data, I think 1. would be sufficient for what we need - a little more manual work per week but we'd just need to do it for a quarter or two.

devoncarew avatar Aug 29 '22 16:08 devoncarew

I think you can use Google Sheet add-on for Google Analytics for 1. to minimize manual work. See https://developers.google.com/analytics/solutions/google-analytics-spreadsheet-add-on

Happy to help with 2. as well!

jayoung-lee avatar Aug 29 '22 17:08 jayoung-lee

Thanks Jayoung for the link. I have created this sheet that generates Google analytics report reflecting data from last 90 days. The report is scheduled to run daily.

On the third tab, I have also added a visualization chart that should get updated automatically as well.

https://docs.google.com/spreadsheets/d/1IBrwsMk_mkZVP4_GaCJ9hwjxV09U8OgVo955-EekaHM/edit#gid=0

khyati82 avatar Sep 13 '22 18:09 khyati82

Created the dashboard as well Who/When are we looking at these progress metrics?

khyati82 avatar Sep 19 '22 22:09 khyati82

@mit-mit can you please take a look at what Khyati has so far?

nuritzi avatar Sep 20 '22 15:09 nuritzi