devtools icon indicating copy to clipboard operation
devtools copied to clipboard

test(e2e): initial commit to setup playwright with devtools package

Open JessicaSachs opened this issue 1 year ago โ€ข 1 comments

๐Ÿ”— Linked issue

โ“ Type of change

  • [ ] ๐Ÿ“– Documentation (updates to the documentation or readme)
  • [ ] ๐Ÿž Bug fix (a non-breaking change that fixes an issue)
  • [ ] ๐Ÿ‘Œ Enhancement (improving an existing functionality)
  • [ ] โœจ New feature (a non-breaking change that adds functionality)
  • [x] ๐Ÿงน Chore (updates to the build process or auxiliary tools and libraries)
  • [ ] โš ๏ธ Breaking change (fix or feature that would cause existing functionality to change)

๐Ÿ“š Description

Adding Playwright E2E testing to the developer workflow in order to catch regressions in browsers before they land in the stable channels of major browsers.

E2E Test TODOS

  • [x] Install and configure Playwright
  • [x] Add ability to launch and wait for internal server endpoint to return success code
  • [x] Write a smoke test with Playwright E2E
  • [x] Add a11y improvements to home page to be able to locate elements without coupling to DOM structure
  • [x] Create a GHA to run Playwright in CI on PRs
  • [x] Add package.json task to execute E2E tests locally (currently pnpm playwright test)

Cross-browser Test TODOS

Can be split out into its own PR. Adding Playwright without comprehensive cross-browser testing will still catch Chromium issues.

  • [ ] Set up SauceLabs to add cross-browser support for the smoke test
  • [ ] Add SauceLabs actions (Sauce Connect)
  • [ ] Add video to this PR and instructions to README/CONTRIBUTING file
  • [ ] Add package.json task to execute Sauce Labs-enabled E2E tests locally
  • [ ] Add .env.local details to document required environment variables
  • [ ] Create weekly/nightly Sauce Labs job to target Dev and Beta Chrome channels
  • [ ] Cut over credentials to Anthony/Nuxt Core team

JessicaSachs avatar Sep 24 '24 20:09 JessicaSachs

Sorry for the delay. I think it would be safer to test against the production build - I will try to improve the test setup. Thanks a lot!

antfu avatar Oct 12 '24 03:10 antfu