Running E2E tests in shards

[keithwillcode]

trafficstars

What does this PR do?

Runs the E2E test suite in shards

Type of change

• Chore (refactoring code, technical debt, workflow improvements)

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
api	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	May 27, 2023 10:08pm
cal	❌ Failed (Inspect)			May 27, 2023 10:08pm

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
ui	⬜️ Ignored (Inspect)	Visit Preview		May 27, 2023 10:08pm

[github-actions[bot]]

📦 Next.js Bundle Analysis for @calcom/web

This analysis was generated by the Next.js Bundle Analysis action. 🤖

Ten Pages Changed Size

The following pages changed size from the code in this PR compared to its base branch:

Page	Size (compressed)	First Load	% of Budget (350 KB)
/[user]/book	256.2 KB	407.15 KB	116.33% (🟡 +0.14%)
/apps/[slug]/[...pages]	457.86 KB	608.81 KB	173.95% (🟢 -0.25%)
/auth/setup	174.22 KB	325.17 KB	92.91% (🟢 -0.16%)
/d/[link]/book	255.84 KB	406.79 KB	116.23% (🟡 +0.14%)
/event-types/[type]	479.43 KB	630.38 KB	180.11% (🟢 -0.19%)
/getting-started/[[...step]]	426.91 KB	577.86 KB	165.10% (🟡 +0.23%)
/new-booker/[user]/[type]	291.42 KB	442.37 KB	126.39% (🟡 +0.14%)
/new-booker/team/[slug]/[type]	291.42 KB	442.37 KB	126.39% (🟡 +0.14%)
/settings/my-account/calendars	253.07 KB	404.02 KB	115.43% (🟡 +0.24%)
/team/[slug]/book	255.85 KB	406.8 KB	116.23% (🟡 +0.14%)

Details

Only the gzipped size is provided here based on an expert tip.

First Load is the size of the global bundle plus the bundle for the individual page. If a user were to show up to your website and land on a given page, the first load size represents the amount of javascript that user would need to download. If next/link is used, subsequent page loads would only need to download that page's bundle (the number in the "Size" column), since the global bundle has already been downloaded.

Any third party scripts you have added directly to your app using the <script> tag are not accounted for in this analysis

The "Budget %" column shows what percentage of your performance budget the First Load total takes up. For example, if your budget was 100kb, and a given page's first load size was 10kb, it would be 10% of your budget. You can also see how much this has increased or decreased compared to the base branch of your PR. If this percentage has increased by 20% or more, there will be a red status indicator applied, indicating that special attention should be given to this. If you see "+/-

[deploysentinel[bot]]

Current Playwright Test Results Summary

✅ 66 Passing - ❌ 1 Failing - ⚠️ 5 Flaky

Run may still be in progress, this comment will be updated as current testing workflow or job completes...

(Last updated on 05/26/2023 04:20:02pm UTC)

Run Details

Running Workflow PR Update on Github Actions

Commit: 0e5ef0a546771c054b05da01dce6695f765d113c

Started: 05/26/2023 04:12:22pm UTC

❌ Failures

📄   apps/web/playwright/booking-seats.e2e.ts • 1 Failure

Test Case Results

Test Case	Last 7 days Failures	Last 7 days Flakes
Booking with Seats -- new-booker Multiple Attendees can book a seated event time slot Retry 2 • Retry 1 • Initial Attempt Error: Test timeout of 60000ms exceeded. Test timeout of 60000ms exceeded.	0.90% (4) 4 / 444 runs failed over last 7 days	0% (0) 0 / 444 runs flaked over last 7 days

---

⚠️ Flakes

📄   apps/web/playwright/event-types.e2e.ts • 1 Flake

Test Case Results

Test Case	Last 7 days Failures	Last 7 days Flakes
Event Types tests user -- new-booker can add multiple organizer address Retry 1 • Initial Attempt	1.40% (6) 6 / 430 runs failed over last 7 days	9.30% (40) 40 / 430 runs flaked over last 7 days

---

📄   apps/web/playwright/embed-code-generator.e2e.ts • 1 Flake

Test Case Results

Test Case	Last 7 days Failures	Last 7 days Flakes
Embed Code Generator Tests Event Type Edit Page open Embed Dialog for the Event Type Retry 1 • Initial Attempt	3.02% (13) 13 / 430 runs failed over last 7 days	29.07% (125) 125 / 430 runs flaked over last 7 days

---

📄   apps/web/playwright/booking-seats.e2e.ts • 2 Flakes

Top 1 Common Error Messages

null	2 Test Cases Affected

Test Case Results

Test Case	Last 7 days Failures	Last 7 days Flakes
Booking with Seats -- new-booker Reschedule for booking with seats -- old-booker Should reschedule booking with seats and if everyone rescheduled it should be deleted Retry 1 • Initial Attempt	0% (0) 0 / 439 runs failed over last 7 days	86.79% (381) 381 / 439 runs flaked over last 7 days
Booking with Seats -- old-booker Reschedule for booking with seats -- new-booker Should reschedule booking with seats and if everyone rescheduled it should be deleted Retry 1 • Initial Attempt	0% (0) 0 / 438 runs failed over last 7 days	19.86% (87) 87 / 438 runs flaked over last 7 days

---

📄   apps/web/playwright/booking-pages.e2e.ts • 1 Flake

Test Case Results

Test Case	Last 7 days Failures	Last 7 days Flakes
free user -- new-booker cannot book same slot multiple times Retry 1 • Initial Attempt	1.30% (6) 6 / 460 runs failed over last 7 days	0.43% (2) 2 / 460 runs flaked over last 7 days

---

View Detailed Build Results

---