metamask-extension icon indicating copy to clipboard operation
metamask-extension copied to clipboard

Capture user actions times for MV2 benchmark and generate artifacts

Open seaona opened this issue 3 years ago • 6 comments

Explanation

We need a way to measure the delay caused by a service-worker re-start on common user actions along the application. For that, this PR will take care of measuring common action times, on an MV2 test build, so we have this time reference. Actions covered:

  • how much time it takes for loading a newly created account (from Create Account button until balance is loaded)
  • how much time it takes from clicking Confirm tx until Tx is confirmed

More Information

  • Closes #15282
  • Closes #15290
  • Closes #15292

Manual Testing Steps

Check the build artifacts created on this branch by Metamaskbot, and ensure that there is a file mv3 that captures mv3 e2e actions stats.

Pre-Merge Checklist

  • [x] PR template is filled out
  • [ ] IF this PR fixes a bug, a test that would have caught the bug has been added [n/a]
  • [x] PR is linked to the appropriate GitHub issue
  • [ ] PR has been added to the appropriate release Milestone [n/a]

+ If there are functional changes:

  • [ ] Manual testing complete & passed [n/a]
  • [ ] "Extension QA Board" label has been applied [n/a]

For testing, check the last MetaMask bot artifacts generated under MV2 E2e Actions Stats.

https://user-images.githubusercontent.com/54408225/183688166-d4c9fd98-83cb-4afb-8381-efaa773c5c85.mp4

seaona avatar Jul 27 '22 08:07 seaona

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

github-actions[bot] avatar Jul 27 '22 08:07 github-actions[bot]

Builds ready [bc825bb]
Page Load Metrics (2176 ± 148 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint1021981432512
domContentLoaded172926252124298143
load172927532176309148
domInteractive172926252124298143

metamaskbot avatar Jul 27 '22 11:07 metamaskbot

Builds ready [ac4e9a1]
Page Load Metrics (1767 ± 46 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint881713195349168
domContentLoaded1583201117419445
load1617201117679746
domInteractive1583201117419445

metamaskbot avatar Aug 08 '22 17:08 metamaskbot

Builds ready [ac4e9a1]
Page Load Metrics (1767 ± 46 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint881713195349168
domContentLoaded1583201117419445
load1617201117679746
domInteractive1583201117419445

metamaskbot avatar Aug 08 '22 18:08 metamaskbot

Builds ready [38ff22c]
Page Load Metrics (1754 ± 43 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint91142109136
domContentLoaded1587187617408038
load1587193117549043
domInteractive1585187617408038

metamaskbot avatar Aug 09 '22 15:08 metamaskbot

Builds ready [4049eac]
Page Load Metrics (1743 ± 36 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint891859197382183
domContentLoaded1644186417256431
load1644193117437636
domInteractive1644186417256431

metamaskbot avatar Aug 09 '22 18:08 metamaskbot

@digiwand thank you v much for the feedback! I've updated it

seaona avatar Aug 10 '22 14:08 seaona

Builds ready [5b04124]
Page Load Metrics (1850 ± 70 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint931808278510245
domContentLoaded16292184183114067
load16302184185014670
domInteractive16292184183114067

metamaskbot avatar Aug 11 '22 15:08 metamaskbot

Builds ready [3f0ea3e]
Page Load Metrics (1963 ± 144 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint853041214722
domContentLoaded158425181940292140
load161226221963300144
domInteractive158425181939292140

metamaskbot avatar Aug 12 '22 07:08 metamaskbot