fast icon indicating copy to clipboard operation
fast copied to clipboard

Use Playwright with Storybook for component tests in fast-foundation

Open radium-v opened this issue 2 years ago • 10 comments

Pull Request

📖 Description

Converts the test suite in fast-foundation from Karma to Playwright.

🎫 Issues

Resolves #5805

👩‍💻 Reviewer Notes

📑 Test Plan

✅ Checklist

General

  • [ ] I have included a change request file using $ yarn change
  • [x] I have added tests for my changes.
  • [x] I have tested my changes.
  • [ ] I have updated the project documentation to reflect my changes.
  • [x] I have read the CONTRIBUTING documentation and followed the standards for this project.

Component-specific

⏭ Next Steps

radium-v avatar Jul 07 '22 00:07 radium-v

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Jul 11 '22 17:07 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Jul 18 '22 20:07 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Jul 19 '22 21:07 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Jul 19 '22 23:07 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Jul 30 '22 00:07 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 02 '22 01:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 02 '22 01:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 02 '22 01:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 09 '22 23:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 11 '22 01:08 github-actions[bot]

📊 Tachometer Benchmark Results

Summary

clickTrigger10x

  • repeat-basic-splice-itemCount=1000&deleteCount=20&addCount=20: unsure 🔍 -2% - +4% (-3.54ms - +6.46ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-basic-splice-loopCount=1000&itemCount=1000&deleteCount=10&addCount=10: unsure 🔍 -2% - +1% (-3.07ms - +2.21ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-push-itemCount=100&addCount=20: unsure 🔍 -1% - +0% (-1.62ms - +0.77ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-push-loopCount=200&itemCount=200: unsure 🔍 -0% - +1% (-4.55ms - +64.96ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-reverse-itemCount=100: unsure 🔍 -1% - +1% (-3.46ms - +3.22ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-reverse-loopCount=200&itemCount=200: unsure 🔍 -1% - +2% (-64.33ms - +84.47ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-shift-itemCount=100: unsure 🔍 -0% - +1% (-0.37ms - +2.23ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-shift-loopCount=200&itemCount=200: unsure 🔍 -0% - +1% (-9.97ms - +41.00ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-unshift-itemCount=100&addCount=20: unsure 🔍 -2% - +0% (-6.37ms - +0.79ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-unshift-loopCount=200&itemCount=200&addCount=1: unsure 🔍 -0% - +3% (-8.26ms - +107.62ms)
    users/jokreitl/foundation-playwright vs master Customize summary

create10k

  • render-create10k: unsure 🔍 -1% - +2% (-3.11ms - +5.39ms)
    users/jokreitl/foundation-playwright vs master Customize summary

createDelete5x

  • render-createDelete5x: unsure 🔍 -1% - +1% (-3.56ms - +2.40ms)
    users/jokreitl/foundation-playwright vs master Customize summary

runFile1k

  • observable-runFile1k: slower ❌ 0% - 32% (0.09ms - 2.48ms)
    users/jokreitl/foundation-playwright vs master Customize summary

update10th

  • render-update10th: unsure 🔍 -3% - +1% (-4.95ms - +2.32ms)
    users/jokreitl/foundation-playwright vs master Customize summary

usedJSHeapSize

  • observable-runFile1k: faster ✔ 0% - 1% (0.02ms - 0.65ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • render-create10k: unsure 🔍 -0% - +0% (-0.00ms - +0.01ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • render-createDelete5x: unsure 🔍 -0% - +0% (-0.06ms - +0.03ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • render-update10th: unsure 🔍 -0% - +0% (-0.01ms - +0.01ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-basic-splice-itemCount=1000&deleteCount=20&addCount=20: unsure 🔍 -0% - +0% (-0.05ms - +0.02ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-basic-splice-loopCount=1000&itemCount=1000&deleteCount=10&addCount=10: unsure 🔍 -0% - +0% (-0.02ms - +0.02ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-push-itemCount=100&addCount=20: unsure 🔍 -0% - +0% (-0.06ms - +0.04ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-push-loopCount=200&itemCount=200: unsure 🔍 -0% - +0% (-0.04ms - +0.02ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-reverse-itemCount=100: unsure 🔍 -0% - +0% (-0.12ms - +0.11ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-reverse-loopCount=200&itemCount=200: unsure 🔍 -0% - +0% (-0.03ms - +0.01ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-shift-itemCount=100: unsure 🔍 -0% - +0% (-0.04ms - +0.07ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-shift-loopCount=200&itemCount=200: unsure 🔍 -0% - +0% (-0.02ms - +0.02ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-unshift-itemCount=100&addCount=20: unsure 🔍 -0% - +0% (-0.05ms - +0.08ms)
    users/jokreitl/foundation-playwright vs master Customize summary
  • repeat-nested-unshift-loopCount=200&itemCount=200&addCount=1: unsure 🔍 -0% - +0% (-0.02ms - +0.01ms)
    users/jokreitl/foundation-playwright vs master Customize summary

Results

observable-runFile1k

runFile1k

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master7.30ms - 8.88ms-faster ✔
2% - 26%
0.09ms - 2.48ms
users/jokreitl/foundation-playwright8.48ms - 10.28msslower ❌
0% - 32%
0.09ms - 2.48ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master48.80ms - 49.21ms-slower ❌
0% - 1%
0.02ms - 0.65ms
users/jokreitl/foundation-playwright48.43ms - 48.91msfaster ✔
0% - 1%
0.02ms - 0.65ms
-
render-create10k

create10k

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master240.86ms - 246.92ms-unsure 🔍
-2% - +1%
-5.39ms - +3.11ms
users/jokreitl/foundation-playwright242.05ms - 248.01msunsure 🔍
-1% - +2%
-3.11ms - +5.39ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master47.25ms - 47.26ms-unsure 🔍
-0% - +0%
-0.01ms - +0.00ms
users/jokreitl/foundation-playwright47.26ms - 47.27msunsure 🔍
-0% - +0%
-0.00ms - +0.01ms
-
render-createDelete5x

createDelete5x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master311.44ms - 315.41ms-unsure 🔍
-1% - +1%
-2.40ms - +3.56ms
users/jokreitl/foundation-playwright310.61ms - 315.07msunsure 🔍
-1% - +1%
-3.56ms - +2.40ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master54.53ms - 54.59ms-unsure 🔍
-0% - +0%
-0.03ms - +0.06ms
users/jokreitl/foundation-playwright54.52ms - 54.58msunsure 🔍
-0% - +0%
-0.06ms - +0.03ms
-
render-update10th

update10th

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master190.84ms - 196.14ms-unsure 🔍
-1% - +3%
-2.32ms - +4.95ms
users/jokreitl/foundation-playwright189.68ms - 194.66msunsure 🔍
-3% - +1%
-4.95ms - +2.32ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master47.26ms - 47.27ms-unsure 🔍
-0% - +0%
-0.01ms - +0.01ms
users/jokreitl/foundation-playwright47.26ms - 47.28msunsure 🔍
-0% - +0%
-0.01ms - +0.01ms
-
repeat-basic-splice-itemCount=1000&deleteCount=20&addCount=20

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master146.67ms - 154.43ms-unsure 🔍
-4% - +2%
-6.46ms - +3.54ms
users/jokreitl/foundation-playwright148.86ms - 155.16msunsure 🔍
-2% - +4%
-3.54ms - +6.46ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master46.37ms - 46.44ms-unsure 🔍
-0% - +0%
-0.02ms - +0.05ms
users/jokreitl/foundation-playwright46.38ms - 46.40msunsure 🔍
-0% - +0%
-0.05ms - +0.02ms
-
repeat-basic-splice-loopCount=1000&itemCount=1000&deleteCount=10&addCount=10

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master188.69ms - 192.59ms-unsure 🔍
-1% - +2%
-2.21ms - +3.07ms
users/jokreitl/foundation-playwright188.44ms - 191.99msunsure 🔍
-2% - +1%
-3.07ms - +2.21ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master53.45ms - 53.48ms-unsure 🔍
-0% - +0%
-0.02ms - +0.02ms
users/jokreitl/foundation-playwright53.45ms - 53.48msunsure 🔍
-0% - +0%
-0.02ms - +0.02ms
-
repeat-nested-push-itemCount=100&addCount=20

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master240.38ms - 242.49ms-unsure 🔍
-0% - +1%
-0.77ms - +1.62ms
users/jokreitl/foundation-playwright240.46ms - 241.56msunsure 🔍
-1% - +0%
-1.62ms - +0.77ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master51.82ms - 51.89ms-unsure 🔍
-0% - +0%
-0.04ms - +0.06ms
users/jokreitl/foundation-playwright51.81ms - 51.89msunsure 🔍
-0% - +0%
-0.06ms - +0.04ms
-
repeat-nested-push-loopCount=200&itemCount=200

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master6274.15ms - 6319.99ms-unsure 🔍
-1% - +0%
-64.96ms - +4.55ms
users/jokreitl/foundation-playwright6301.14ms - 6353.40msunsure 🔍
-0% - +1%
-4.55ms - +64.96ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master91.53ms - 91.58ms-unsure 🔍
-0% - +0%
-0.02ms - +0.04ms
users/jokreitl/foundation-playwright91.53ms - 91.56msunsure 🔍
-0% - +0%
-0.04ms - +0.02ms
-
repeat-nested-reverse-itemCount=100

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master380.59ms - 385.44ms-unsure 🔍
-1% - +1%
-3.22ms - +3.46ms
users/jokreitl/foundation-playwright380.59ms - 385.19msunsure 🔍
-1% - +1%
-3.46ms - +3.22ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master58.57ms - 58.74ms-unsure 🔍
-0% - +0%
-0.11ms - +0.12ms
users/jokreitl/foundation-playwright58.58ms - 58.73msunsure 🔍
-0% - +0%
-0.12ms - +0.11ms
-
repeat-nested-reverse-loopCount=200&itemCount=200

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master5328.17ms - 5431.25ms-unsure 🔍
-2% - +1%
-84.47ms - +64.33ms
users/jokreitl/foundation-playwright5336.13ms - 5443.44msunsure 🔍
-1% - +2%
-64.33ms - +84.47ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master131.00ms - 131.03ms-unsure 🔍
-0% - +0%
-0.01ms - +0.03ms
users/jokreitl/foundation-playwright130.99ms - 131.01msunsure 🔍
-0% - +0%
-0.03ms - +0.01ms
-
repeat-nested-shift-itemCount=100

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master217.41ms - 218.96ms-unsure 🔍
-1% - +0%
-2.23ms - +0.37ms
users/jokreitl/foundation-playwright218.07ms - 220.16msunsure 🔍
-0% - +1%
-0.37ms - +2.23ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master51.81ms - 51.88ms-unsure 🔍
-0% - +0%
-0.07ms - +0.04ms
users/jokreitl/foundation-playwright51.83ms - 51.91msunsure 🔍
-0% - +0%
-0.04ms - +0.07ms
-
repeat-nested-shift-loopCount=200&itemCount=200

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master6142.81ms - 6179.13ms-unsure 🔍
-1% - +0%
-41.00ms - +9.97ms
users/jokreitl/foundation-playwright6158.61ms - 6194.37msunsure 🔍
-0% - +1%
-9.97ms - +41.00ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master90.94ms - 90.97ms-unsure 🔍
-0% - +0%
-0.02ms - +0.02ms
users/jokreitl/foundation-playwright90.94ms - 90.97msunsure 🔍
-0% - +0%
-0.02ms - +0.02ms
-
repeat-nested-unshift-itemCount=100&addCount=20

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master296.00ms - 301.32ms-unsure 🔍
-0% - +2%
-0.79ms - +6.37ms
users/jokreitl/foundation-playwright293.47ms - 298.26msunsure 🔍
-2% - +0%
-6.37ms - +0.79ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master51.73ms - 51.82ms-unsure 🔍
-0% - +0%
-0.08ms - +0.05ms
users/jokreitl/foundation-playwright51.75ms - 51.84msunsure 🔍
-0% - +0%
-0.05ms - +0.08ms
-
repeat-nested-unshift-loopCount=200&itemCount=200&addCount=1

clickTrigger10x

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master3724.43ms - 3787.89ms-unsure 🔍
-3% - +0%
-107.62ms - +8.26ms
users/jokreitl/foundation-playwright3757.37ms - 3854.32msunsure 🔍
-0% - +3%
-8.26ms - +107.62ms
-

usedJSHeapSize

VersionAvg timevs mastervs users/jokreitl/foundation-playwright
master91.47ms - 91.48ms-unsure 🔍
-0% - +0%
-0.01ms - +0.02ms
users/jokreitl/foundation-playwright91.45ms - 91.48msunsure 🔍
-0% - +0%
-0.02ms - +0.01ms
-

tachometer-reporter-action v2 for Validate Benchmarks

github-actions[bot] avatar Aug 26 '22 02:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 26 '22 03:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 26 '22 19:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 31 '22 01:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Aug 31 '22 01:08 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 03 '22 04:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 16 '22 03:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 16 '22 21:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 16 '22 21:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 16 '22 23:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 16 '22 23:09 github-actions[bot]

Azure Static Web Apps: Your stage site is ready! Visit it here: https://purple-ocean-0b7ce3410-6189.centralus.azurestaticapps.net

github-actions[bot] avatar Sep 17 '22 00:09 github-actions[bot]