cypress-realworld-app icon indicating copy to clipboard operation
cypress-realworld-app copied to clipboard

FLAKY TEST BRANCH

Open panzarino opened this issue 4 years ago • 1 comments

Flaky Test Branch

This branch intentionally contains flaky tests and serves as a demonstration of how the dashboard can help you recognize and reduce flakiness in your testing suite

You can check out flake analytics for this branch in the Cypress Dashboard here. You can also scroll down on this thread to see how the Cypress Dashboard GitHub Integration handles flaky tests.

Note to maintainers - do not merge and permanently leave in "draft" state

panzarino avatar Apr 09 '21 18:04 panzarino

17 failed and 36 flaky tests on run #6193 ↗︎

17 439 2 0 Flakiness 36

Details:

Merge branch 'develop' into flake-demo
Project: cypress-realworld-app Commit: f013338437
Status: Failed Duration: 29:09 💡
Started: Nov 14, 2023 9:00 PM Ended: Nov 14, 2023 9:29 PM
Failed  notifications.spec.ts • 2 failed tests • UI - Firefox - Mobile

View Output

Test Artifacts
Notifications > notifications from user interactions > User C likes a transaction between User A and User B; User A and User B get notifications that User C liked transaction Screenshots
Notifications > notifications from user interactions > User C comments on a transaction between User A and User B; User A and B get notifications that User C commented on their transaction Screenshots
Failed  notifications.spec.ts • 1 failed test • Component

View Output

Test Artifacts
Notifications > notifications from user interactions > User C likes a transaction between User A and User B; User A and User B get notifications that User C liked transaction Test Replay Screenshots
Failed  transaction-feeds.spec.ts • 1 failed test • Component

View Output

Test Artifacts
Transaction Feed > renders and paginates all transaction feeds > renders transactions item variations in feed Test Replay Screenshots
Failed  notifications.spec.ts • 2 failed tests • UI - Chrome - Mobile

View Output

Test Artifacts
Notifications > notifications from user interactions > User C likes a transaction between User A and User B; User A and User B get notifications that User C liked transaction Test Replay Screenshots
Notifications > notifications from user interactions > User C comments on a transaction between User A and User B; User A and B get notifications that User C commented on their transaction Test Replay Screenshots
Failed  new-transaction.spec.ts • 1 failed test • UI - Chrome - Mobile

View Output

Test Artifacts
New Transaction > submits a transaction request and accepts the request for the receiver Test Replay Screenshots

The first 5 failed specs are shown, see all 12 specs in Cypress Cloud.

Flakiness  transaction-feeds.spec.ts • 5 flaky tests • UI - Firefox - Mobile

View Output

Test Artifacts
Transaction Feed > renders and paginates all transaction feeds > renders transactions item variations in feed Screenshots
Transaction Feed > renders and paginates all transaction feeds > paginates public transaction feed Screenshots
Transaction Feed > filters transaction feeds by date range > filters public transaction feed by date range Screenshots
Transaction Feed > filters transaction feeds by date range > does not show public transactions for out of range date limits Screenshots
Transaction Feed > filters transaction feeds by amount range > does not show public transactions for out of range amount limits Screenshots
Flakiness  new-transaction.spec.ts • 2 flaky tests • UI - Firefox - Mobile

View Output

Test Artifacts
New Transaction > submits a transaction payment and verifies the deposit for the receiver Screenshots
New Transaction > submits a transaction request and accepts the request for the receiver Screenshots
Flakiness  notifications.spec.ts • 2 flaky tests • Component

View Output

Test Artifacts
Notifications > notifications from user interactions > FLAKE User A likes a transaction of User B; User B gets notification that User A liked transaction Test Replay Screenshots
Notifications > notifications from user interactions > User A sends a payment request to User C Test Replay Screenshots
Flakiness  new-transaction.spec.ts • 2 flaky tests • Component

View Output

Test Artifacts
New Transaction > submits a transaction payment and verifies the deposit for the receiver Test Replay Screenshots
New Transaction > submits a transaction request and accepts the request for the receiver Test Replay Screenshots
Flakiness  transaction-feeds.spec.ts • 3 flaky tests • Component

View Output

Test Artifacts
Transaction Feed > filters transaction feeds by date range > filters public transaction feed by date range Test Replay Screenshots
Transaction Feed > filters transaction feeds by date range > does not show public transactions for out of range date limits Test Replay Screenshots
Transaction Feed > Feed Item Visibility > FLAKE first five items belong to contacts in public feed Test Replay Screenshots

The first 5 flaky specs are shown, see all 17 specs in Cypress Cloud.

Review all test suite changes for PR #875 ↗︎

cypress[bot] avatar Apr 09 '21 19:04 cypress[bot]

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
12 out of 16 committers have signed the CLA.

:white_check_mark: astone123
:white_check_mark: mjhenkes
:white_check_mark: mschile
:white_check_mark: MikeMcC399
:white_check_mark: chrisbreiding
:white_check_mark: AtofStryker
:white_check_mark: cacieprins
:white_check_mark: warrensplayer
:white_check_mark: allexiusw
:white_check_mark: dolmasherpa123455
:white_check_mark: trivikr
:white_check_mark: jennifer-shehane
:x: emilyrohrbough
:x: ryanthemanuel
:x: elylucas
:x: Ben M


Ben M seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Apr 17 '23 15:04 CLAassistant