equalify icon indicating copy to clipboard operation
equalify copied to clipboard

Tests Before Version One is Launched

Open bbertucc opened this issue 6 months ago • 1 comments

Overview

In order to launch Version 1 we have to confirm that the following user experience tests are passed. @kevinandrews1 will test JAWS and NVDA. @bbertucc will test Safari, Chrome, and Apple VoiceOver. Once passed, we can launch version 1.

Fail/Pass Items

  • [ ] User experience tests passed when browsing on Safari?
  • [ ] User experience tests passed when browsing on Chrome?
  • [ ] User experience tests passed on JAWS?
  • [ ] User experience tests passed on NVDA?
  • [ ] User experience tests passed on Apple VoiceOver?

User Experience Tests

Signup and Verification

Start URL: https://dashboard.equalify.app/signup Test:

  1. The following fields are editable and property labeled: First Name, Last Name, Email, Password, Confirm Password
  2. Hide and show password button works
  3. On clicking "continue," fields have proper validation: First name is required, Last name is required, Please enter a valid email address, Password must be at least 6 characters, Passwords don't match.
  4. Users cannot add duplicate users.
  5. Successfully clicking "continue" launches a notification "A verification code has been sent to your email."
  6. When clicking from the email, validate verification announcing "Invalid verification code provided, please try again." if the code isn't correct.
  7. Code can be resent to email.
  8. On successfully validating after clicking "Verify and Sign Up" button, add notification "Account verified successfully" then redirect to reports page.

Note: When testing on a screen reader, the signup page and email verification page should be read out in addition to all form verification notifications.

Login

Start URL: https://dashboard.equalify.app/signup Test:

  1. Click the "Log In" link
  2. Enter in an invalid login.
  3. Should be prompted with an error "incorrect username or password"
  4. Enter in a correct login.
  5. Verification message: "Verification successful. Redirecting to reports page"
  6. On reports page.

Note: When testing on a screen reader, the signup page and email verification page should be read out in addition to all form verification notifications.

Creating a Report and Viewing Basic Data

Start URL: https://dashboard.equalify.app/reports Test:

  1. You are logged out, you visit the url and it redirects you to the login.
  2. After login, you are redirected to the reports page.
  3. You have no properties.
  4. "Create a report" button takes you to the "Create New Report" page.
  5. All fields on page are disabled with an alert above form that says "You must have one property to create report."
  6. Click "Cancel".
  7. You are redirected to the Reports page.
  8. After creating a property, return to "Create Report".
  9. You select "Properties" under the "Filter By" dropdown field.
  10. You can now search by properties. As you type the name of the property, suggestions appear.
  11. Select the property you created
  12. Click "Create Report"
  13. You are notified "Report created successfully" and redirected to the reports page.
  14. Now scan your property then go back to the reports page.
  15. Click "View Report" of the report you created.
  16. On the report page, your report should be fully populated with chart data that includes the number of equalified and active issues each day, a list of messages with a count of total equalified and active nodes per message, a list of tags, and a list of urls.
  17. The message, tag, and page lists are paginated.
  18. Where pagination is present, click to the next page of results to see the results loaded.

Browsing Message Details Page

Start URL: https://dashboard.equalify.app/reports

  1. Click on a report with content.
  2. Click on a message.
  3. You are taken to a Message detail page with chart data filtered to the message that includes the number of equalified and active issues each day and a list of code snippets related to the message with a page url and status.
  4. The code snippets list is paginated if there are over 10 code snippets.
  5. If pagination is present, click to the next page of results to see the results loaded.
  6. Click the Report name at the top of the page to go back to the report.

Browsing URL Details Page

Start URL: https://dashboard.equalify.app/reports

  1. Click on a report with content.
  2. Click on a URL in the page list.
  3. You are taken to a Page detail page with chart data filtered to the page that includes the number of equalified and active issues each day and a list of code snippets messages related to the page with the code.
  4. The code snippets list is paginated if there are over 10 code snippets.
  5. If pagination is present, click to the next page of results to see the results loaded.
  6. Click the Report name at the top of the page to go back to the report.

Browsing Tag Details Page

Start URL: https://dashboard.equalify.app/reports

  1. Click on a report with content.
  2. Click on a Tag in the tag list.
  3. You are taken to a Tag detail page with chart data filtered to the page that includes the number of equalified and active issues each day and a list of messages related to the tag with a count of equalify and active for each message.
  4. The messages list is paginated if there are over 10 messages.
  5. If pagination is present, click to the next page of results to see the results loaded.
  6. Click the Report name at the top of the page to go back to the report.

Editing a Report

Start URL: https://dashboard.equalify.app/reports

  1. Click on a report with content.
  2. Click edit report.
  3. The report should only have one filter, filtering by a single property.
  4. Add a filter for a message by selected the dropdown under filter by and typing content text related to a message
  5. You should be prompted with options of different messages.
  6. Select a message.
  7. A notification should say "Message filter added"
  8. Remove the added message.
  9. A notification should say "Message filter removed."
  10. Add two more messages, then click Update report.
  11. You should be taken back to the report page then a notification should say "Report updated successfully."
  12. The report should only be listing data related to the messages you selected.
  13. Go back to "edit report".
  14. Add in three additional messages.
  15. Click update report.
  16. You should be taken back to the report page then a notification should say "Report updated successfully."
  17. The report should only be listing data related to the messages you selected.
  18. Go back to "edit report".
  19. Add in three additional url.
  20. Click update report.
  21. You should be taken back to the report page then a notification should say "Report updated successfully."
  22. The report should only be listing data related to the messages you selected.
  23. Go back to "edit report".
  24. Delete all the filters.
  25. Click update report.
  26. You should receive a notification that you cannot update a report if there are no filters.
  27. Add in the property filter.
  28. Click update report.
  29. You should be taken back to the report page then a notification should say "Report updated successfully."
  30. The report should only be listing data related to the messages you selected.

Scanning a New Property with Single Page Discovery

Start URL: https://dashboard.equalify.app/reports Test:

  1. Select "scans" from the navigation.
  2. You should see a table with six columns.
  3. Select "Properties" from the navigation.
  4. Select "Add property" for an existing property
  5. Property Name, URL, and Property Discovery should be required. You should not be able to click "Add Property" without filling in valid fields.
  6. Fill in an invalid URL and click "Add Property"
  7. You should be notified, "Please enter a valid URL".
  8. Enter a valid URL.
  9. Make sure the property has "Property Discovery" set to single.
  10. Click "Add Property".
  11. You should receive a "Property added" notification and you should be sent back to the properties page.
  12. Now edit that property you added.
  13. Send property to scan by clicking "Send to Scan"
  14. You should receive a notification that says "Property sent to scan successfully!"
  15. Navigate back to the Scans page.
  16. If you just sent the property to scan, you should see the property in the table with the status "Processing". Since this is a single scan, you should only see that URL you wanted processing.
  17. After no more than 1 minute, the scan should go from processing to complete.
  18. Click the "Download" link of the scan that you just sent.
  19. A json file of scan data should be sent.
  20. Review scan data to make sure it seems like the information that you added.
  21. Create a report with the property you just scanned selected from the filters and confirm that data is related to the property. There should also be only one URL, since the property was a single page scan.

Scanning a New Property with Sitemap Discovery

Start URL: https://dashboard.equalify.app/reports Test:

  1. Select "scans" from the navigation.
  2. You should see a table with six columns.
  3. Select "Properties" from the navigation.
  4. Select "Add property" for an existing property
  5. Property Name, URL, and Property Discovery should be required. You should not be able to click "Add Property" without filling in valid fields.
  6. Fill in an invalid URL and click "Add Property"
  7. You should be notified, "Please enter a valid URL".
  8. Enter a valid URL.
  9. Make sure the property has "Property Discovery" set to "Sitemap."
  10. Click "Add Property".
  11. You should receive a "Property added" notification and you should be sent back to the properties page.
  12. Now edit that property you added.
  13. Send property to scan by clicking "Send to Scan".
  14. After no more than 1-minute, you should receive a notification that says "Property sent to scan successfully!"
  15. Navigate back to the Scans page.
  16. If you just sent the property to scan, you should see the property in the table with the status "Processing". Since this is a single scan, you should only see URLs related to the property you wanted processing.
  17. After no more than 1 minute per page, the scan should go from processing to complete.
  18. Click the "Download" link of the one page you just sent.
  19. A json file of scan data should be sent.
  20. Review scan data to make sure it seems like the information that you added.
  21. Create a report with the property you just scanned selected from the filters and confirm that data is related to the property.

Logging Out

Start URL: https://dashboard.equalify.app/reports Test:

  1. Click the "My Account" link in navigation
  2. Click "Log Out"
  3. You should receive a notification that "You have logged out" and be redirected to the Login page.

Deleting Account

Start URL: https://dashboard.equalify.app/reports Test:

  1. Click the "My Account" link in navigation
  2. Click "Delete Account"
  3. You should be prompted with a form to confirm account deletion.
  4. Confirm.
  5. You should receive a notification that says "Your account is deleted" and be redirected to the Login page.

bbertucc avatar Aug 01 '24 20:08 bbertucc