cal.com icon indicating copy to clipboard operation
cal.com copied to clipboard

test: Create E2E tests for collective bookings for all questions together as custom/required (teste2e-allQuestionsCollective)

Open gitstart-app[bot] opened this issue 2 years ago • 8 comments

DEMO

We refactored all the existing files to a better organization:

image

image

gitstart-app[bot] avatar Nov 10 '23 19:11 gitstart-app[bot]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
ai ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 26, 2024 7:34am
api ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 26, 2024 7:34am
dev ❌ Failed (Inspect) Jan 26, 2024 7:34am
qa 🔄 Building (Inspect) Visit Preview 💬 Add feedback Jan 26, 2024 7:34am
4 Ignored Deployments
Name Status Preview Comments Updated (UTC)
cal ⬜️ Ignored (Inspect) Visit Preview Jan 26, 2024 7:34am
cal-demo ⬜️ Ignored (Inspect) Visit Preview Jan 26, 2024 7:34am
calcom-web-canary ⬜️ Ignored (Inspect) Visit Preview Jan 26, 2024 7:34am
ui ⬜️ Ignored (Inspect) Visit Preview Jan 26, 2024 7:34am

vercel[bot] avatar Nov 10 '23 19:11 vercel[bot]

Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link.

github-actions[bot] avatar Nov 10 '23 19:11 github-actions[bot]

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

This PR introduced no changes to the JavaScript bundle! 🙌

github-actions[bot] avatar Nov 10 '23 19:11 github-actions[bot]

Current Playwright Test Results Summary

✅ 413 Passing - ❌ 1 Failing - ⚠️ 20 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 01/26/2024 11:42:57am UTC)

Run Details

Running Workflow PR Update on Github Actions

Commit: 0d7387d49e017a9f75ebe8c8a70f12acc29ca691

Started: 01/26/2024 11:34:51am UTC

❌ Failures

📄   apps/web/playwright/booking/collectiveEventType/questions/collectiveEventAllQuestions.e2e.ts • 1 Failure

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Collective Booking With All Questions Selecting and filling all questions as required (Collective Event)
Retry 2Retry 1Initial Attempt
Error: Test timeout of 60000ms exceeded.
Test timeout of 60000ms exceeded.
100% (3) 3 / 3 runs
failed over last 7 days
0% (0) 0 / 3 runs
flaked over last 7 days

⚠️ Flakes

📄   apps/web/playwright/login.2fa.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
2FA Tests should allow a user to enable 2FA and login using 2FA
Retry 2Retry 1Initial Attempt
3.23% (10) 10 / 310 runs
failed over last 7 days
37.74% (117) 117 / 310 runs
flaked over last 7 days

📄   apps/web/playwright/locale.e2e.ts • 13 Flakes

Top 1 Common Error Messages

null

13 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
unauthorized user sees correct translations (de) should use correct translations and html attributes
Retry 1Initial Attempt
-17.78% (-56) -56 / 315 runs
failed over last 7 days
18.10% (57) 57 / 315 runs
flaked over last 7 days
unauthorized user sees correct translations (ar) should use correct translations and html attributes
Retry 1Initial Attempt
-18.15% (-57) -57 / 314 runs
failed over last 7 days
18.15% (57) 57 / 314 runs
flaked over last 7 days
unauthorized user sees correct translations (zh) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
unauthorized user sees correct translations (zh-CN) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
unauthorized user sees correct translations (zh-TW) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
unauthorized user sees correct translations (pt) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
unauthorized user sees correct translations (pt-br) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
unauthorized user sees correct translations (es-419) should use correct translations and html attributes
Retry 1Initial Attempt
-18.21% (-57) -57 / 313 runs
failed over last 7 days
18.21% (57) 57 / 313 runs
flaked over last 7 days
authorized user sees correct translations (de) should return correct translations and html attributes
Retry 1Initial Attempt
-18.33% (-57) -57 / 311 runs
failed over last 7 days
18.33% (57) 57 / 311 runs
flaked over last 7 days
authorized user sees correct translations (pt-br) should return correct translations and html attributes
Retry 1Initial Attempt
-18.33% (-57) -57 / 311 runs
failed over last 7 days
18.33% (57) 57 / 311 runs
flaked over last 7 days
authorized user sees correct translations (ar) should return correct translations and html attributes
Retry 1Initial Attempt
-18.33% (-57) -57 / 311 runs
failed over last 7 days
18.33% (57) 57 / 311 runs
flaked over last 7 days
authorized user sees changed translations (de->ar) should return correct translations and html attributes
Retry 1Initial Attempt
-7.47% (-23) -23 / 308 runs
failed over last 7 days
16.23% (50) 50 / 308 runs
flaked over last 7 days
authorized user sees changed translations (de->pt-BR) [locale1] should return correct translations and html attributes
Retry 1Initial Attempt
-7.47% (-21) -21 / 281 runs
failed over last 7 days
17.44% (49) 49 / 281 runs
flaked over last 7 days

📄   apps/web/playwright/booking/regularEventType/questions/phoneQuestion.e2e.ts • 1 Flake

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking With Phone Question and Each Other Question Booking With Phone Question and Address Question Booking With Phone Question and Radio group Question Phone required and Radio group not required
Retry 1Initial Attempt
0% (0) 0 / 3 runs
failed over last 7 days
33.33% (1) 1 / 3 run
flaked over last 7 days

📄   apps/web/playwright/organization/organization-invitation.e2e.ts • 2 Flakes

Top 1 Common Error Messages

null

2 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Organization Email not matching orgAutoAcceptEmail Team invitation
Retry 1Initial Attempt
3.70% (12) 12 / 324 runs
failed over last 7 days
16.98% (55) 55 / 324 runs
flaked over last 7 days
Organization Email matching orgAutoAcceptEmail and a Verified Organization Team Invitation
Retry 1Initial Attempt
5.63% (18) 18 / 320 runs
failed over last 7 days
10.63% (34) 34 / 320 runs
flaked over last 7 days

📄   apps/web/playwright/booking/regularEventType/questions/multipleEmailQuestion.e2e.ts • 3 Flakes

Top 1 Common Error Messages

null

3 Test Cases Affected

Test Case Results

Test Case Last 7 days Failures Last 7 days Flakes
Booking With Multiple Email Question and Each Other Question Booking With Multiple email Question and phone Question Multiple email required and Phone required
Retry 1Initial Attempt
0% (0) 0 / 3 runs
failed over last 7 days
33.33% (1) 1 / 3 run
flaked over last 7 days
Booking With Multiple Email Question and Each Other Question Booking With Multiple Email Question and Radio group Question Multiple Email and Radio group not required
Retry 1Initial Attempt
0% (0) 0 / 3 runs
failed over last 7 days
66.67% (2) 2 / 3 runs
flaked over last 7 days
Booking With Multiple Email Question and Each Other Question Booking With Multiple Email Question and Radio group Question Booking With Multiple Email Question and Short text question Multiple Email required and Short text required
Retry 1Initial Attempt
0% (0) 0 / 3 runs
failed over last 7 days
33.33% (1) 1 / 3 run
flaked over last 7 days

View Detailed Build Results


deploysentinel[bot] avatar Nov 10 '23 19:11 deploysentinel[bot]

In this test we are checking the same as here but for a collective event-type

gitstart-calcom avatar Nov 23 '23 19:11 gitstart-calcom

This PR is being marked as stale due to inactivity.

github-actions[bot] avatar Dec 13 '23 00:12 github-actions[bot]

This PR is being closed due to inactivity. Please reopen if work is intended to be continued.

github-actions[bot] avatar Dec 21 '23 00:12 github-actions[bot]

This PR is being marked as stale due to inactivity.

github-actions[bot] avatar Jan 05 '24 00:01 github-actions[bot]

Hey there, there is a merge conflict, can you take a look?

github-actions[bot] avatar Jan 23 '24 05:01 github-actions[bot]

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
3 out of 4 committers have signed the CLA.

:white_check_mark: keithwillcode
:white_check_mark: gitstart-calcom
:white_check_mark: DmytroHryshyn
:x: crowdin-bot
You have signed the CLA already but the status is still pending? Let us recheck it.

CLAassistant avatar Jan 24 '24 20:01 CLAassistant