azure-openai-chat-frontend icon indicating copy to clipboard operation
azure-openai-chat-frontend copied to clipboard

[Auto] AI Gallery Standard Validation

Open ai-apps-bot opened this issue 8 months ago • 0 comments

AI Gallery Standard Validation: NON-CONFORMING

Severity: High

Please review the warnings below. If your template is already published, it may be subject to removal from a collection. Head to this link for more information: template-lifecycle

Repository Management:

  • [x] README.md File.
  • [x] LICENSE.md File.
  • [x] SECURITY.md File.
  • [x] CODE_OF_CONDUCT.md File.
  • [x] CONTRIBUTING.md File.
  • [x] ISSUE_TEMPLATE.md File.
  • [x] Topics on repo contains ['azd-templates', 'ai-azd-templates'].

Source code structure and conventions:

  • [x] azure-dev.yml File.
  • [x] azure.yml File.
  • [x] infra Folder.
  • [x] .devcontainer Folder.

Functional Requirements:

  • [ ] :x: azd up. [How to fix?]

    Details

    New environment 'ai8-537344583r20' created and set as default. Initialize bicep provider

    Packaging services (azd package)

    Packaging service chatfrontendapp (✓) Done: Packaging service chatfrontendapp

    • Build Output: ]8;;/workspaces/template/workspaces/template]8;;
    • Build Output: ]8;;/workspaces/template/distdist]8;;

    Provisioning Azure resources (azd provision) Provisioning Azure resources can take some time.

    Initialize bicep provider Reading subscription and location from environment... Subscription: Azure SDK Test Resources - AI Apps (90b334cb-854f-4207-a89c-cf44ab8673fe) Location: Sweden Central

    Creating a deployment plan Comparing deployment state Creating/Updating resources You can view detailed progress in the Azure Portal: https://portal.azure.com/#view/HubsExtension/DeploymentDetailsBlade/~/overview/id/%2Fsubscriptions%2F90b334cb-854f-4207-a89c-cf44ab8673fe%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2Fai8-537344583r20-1761565915

    (✓) Done: Resource group: rg-ai8-537344583r20 (8.335s) (✓) Done: Static Web App: chatfrontendapp (9.187s) (✓) Done: Log Analytics workspace: log-pmjchdnb73d6m (32.54s)

    Deploying services (azd deploy)

    Deploying service chatfrontendapp Deploying service chatfrontendapp (Retrieving deployment token) Deploying service chatfrontendapp (swa cli deploy) (x) Failed: Deploying service chatfrontendapp

    ERROR: error executing step command 'deploy --all': failed deploying service 'chatfrontendapp': service source and output folder cannot be at the root: ./ If your service is at the root of your project, next to azure.yaml, move your service to a subfolder. Azure Static Web Apps does not support deploying from a folder that is for both the service source and the output folder. Update the path of the service in azure.yaml to point to the subfolder and try deploying again.

  • [ ] :warning: npx playwright test. [How to fix?]

    Details

    Running 30 tests using 1 worker

    ✘ 1 [chromium] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (7.7s) ✘ 2 [chromium] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #1) (5.8s) ✘ 3 [chromium] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #2) (5.6s) ✘ 4 [chromium] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (5.5s) ✘ 5 [chromium] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #1) (5.7s) ✘ 6 [chromium] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #2) (5.5s) ✘ 7 [chromium] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (6.0s) ✘ 8 [chromium] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #1) (6.5s) ✘ 9 [chromium] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #2) (6.0s) ✓ 10 [chromium] › tests/e2e/frontendchatapp.spec.ts:144:3 › errors › stream: on server failure (626ms) ✓ 11 [chromium] › tests/e2e/frontendchatapp.spec.ts:165:3 › errors › stream: on bad request (526ms) ✓ 12 [chromium] › tests/e2e/frontendchatapp.spec.ts:189:3 › errors › no stream: on server failure (531ms) ✓ 13 [chromium] › tests/e2e/frontendchatapp.spec.ts:213:3 › errors › no stream: on bad request (506ms) ✓ 14 [chromium] › tests/e2e/frontendchatapp.spec.ts:252:3 › generate answer › show thought process (1.5s) ✘ 15 [chromium] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (5.4s) ✘ 16 [chromium] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #1) (5.7s) ✘ 17 [chromium] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #2) (5.5s) ✘ 18 [chromium] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (30.0s) ✘ 19 [chromium] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #1) (30.1s) ✘ 20 [chromium] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #2) (30.0s) ✘ 21 [firefox] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (7.1s) ✘ 22 [firefox] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #1) (7.5s) ✘ 23 [firefox] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #2) (7.1s) ✘ 24 [firefox] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (7.0s) ✘ 25 [firefox] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #1) (7.2s) ✘ 26 [firefox] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #2) (6.9s) ✘ 27 [firefox] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (7.8s) ✘ 28 [firefox] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #1) (8.3s) ✘ 29 [firefox] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #2) (7.8s) ✓ 30 [firefox] › tests/e2e/frontendchatapp.spec.ts:144:3 › errors › stream: on server failure (2.0s) ✓ 31 [firefox] › tests/e2e/frontendchatapp.spec.ts:165:3 › errors › stream: on bad request (873ms) ✓ 32 [firefox] › tests/e2e/frontendchatapp.spec.ts:189:3 › errors › no stream: on server failure (852ms) ✓ 33 [firefox] › tests/e2e/frontendchatapp.spec.ts:213:3 › errors › no stream: on bad request (809ms) ✓ 34 [firefox] › tests/e2e/frontendchatapp.spec.ts:252:3 › generate answer › show thought process (1.9s) ✘ 35 [firefox] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (5.8s) ✘ 36 [firefox] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #1) (7.2s) ✘ 37 [firefox] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #2) (6.9s) ✘ 38 [firefox] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (30.1s) ✘ 39 [firefox] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #1) (30.4s) ✘ 40 [firefox] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #2) (30.1s) ✘ 41 [webkit] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (5.9s) ✘ 42 [webkit] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #1) (6.5s) ✘ 43 [webkit] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation (retry #2) (5.9s) ✘ 44 [webkit] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (5.8s) ✘ 45 [webkit] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #1) (6.1s) ✘ 46 [webkit] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response (retry #2) (5.8s) ✘ 47 [webkit] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (6.7s) ✘ 48 [webkit] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #1) (7.9s) ✘ 49 [webkit] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history (retry #2) (6.7s) ✓ 50 [webkit] › tests/e2e/frontendchatapp.spec.ts:144:3 › errors › stream: on server failure (944ms) ✓ 51 [webkit] › tests/e2e/frontendchatapp.spec.ts:165:3 › errors › stream: on bad request (854ms) ✓ 52 [webkit] › tests/e2e/frontendchatapp.spec.ts:189:3 › errors › no stream: on server failure (848ms) ✓ 53 [webkit] › tests/e2e/frontendchatapp.spec.ts:213:3 › errors › no stream: on bad request (839ms) ✓ 54 [webkit] › tests/e2e/frontendchatapp.spec.ts:252:3 › generate answer › show thought process (1.7s) ✘ 55 [webkit] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (5.7s) ✘ 56 [webkit] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #1) (6.1s) ✘ 57 [webkit] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation (retry #2) (5.9s) ✘ 58 [webkit] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (30.0s) ✘ 59 [webkit] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #1) (30.1s) ✘ 60 [webkit] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions (retry #2) (30.0s)

    1. [chromium] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation › response formatting
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-chromium/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-chromium-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-interation-chromium-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-interation-chromium-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-chromium-retry2/error-context.md
    
    1. [chromium] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ──────────
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-chromium/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-chromium-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-waiting-for-response-chromium-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-waiting-for-response-chromium-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-chromium-retry2/error-context.md
    
    1. [chromium] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history › chat history after chat
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-chromium/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-chromium-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-history-chromium-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-history-chromium-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-chromium-retry2/error-context.md
    
    1. [chromium] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ─────────────
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-chromium/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-chromium-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-citation-chromium-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-citation-chromium-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-chromium-retry2/error-context.md
    
    1. [chromium] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ──
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-chromium/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-chromium-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-chromium-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-chromium-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-chromium-retry2/error-context.md
    
    1. [firefox] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation › response formatting
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-firefox/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-firefox-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-interation-firefox-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-interation-firefox-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-firefox-retry2/error-context.md
    
    1. [firefox] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ───────────
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-firefox/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-firefox-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-waiting-for-response-firefox-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-waiting-for-response-firefox-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toBeEnabled() failed
    
    Locator:  getByTestId('question-input')
    Expected: not enabled
    Received: enabled
    Timeout:  5000ms
    
    Call log:
      - Expect "not toBeEnabled" with timeout 5000ms
      - waiting for getByTestId('question-input')
        9 × locator resolved to <input :value="" type="text" name="chatbox" autocomplete="off" id="question-input" data-testid="question-input" aria-labelledby="chatbox-label" class="chatbox__input display-flex-grow" placeholder="Type your question, eg. "How to search and book rentals?""/>
          - unexpected value "enabled"
    
    
      76 -     await page.getByTestId('submit-question-button').click();
      77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
    > 78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
         -                                                          ^
      79 -   });
      80 -
      81 -   test('chat history', async ({ page }) => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:78:58
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-firefox-retry2/error-context.md
    
    1. [firefox] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history › chat history after chat
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-firefox/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-firefox-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-history-firefox-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-history-firefox-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-firefox-retry2/error-context.md
    
    1. [firefox] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ──────────────
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-firefox/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-firefox-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-citation-firefox-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-citation-firefox-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-firefox-retry2/error-context.md
    
    1. [firefox] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ──
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-firefox/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-firefox-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-firefox-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-firefox-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-firefox-retry2/error-context.md
    
    1. [webkit] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation › response formatting
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-webkit/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-webkit-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-interation-webkit-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-interation-webkit-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveCount(expected) failed
    
    Locator:  locator('.items__listItem--step')
    Expected: not 0
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveCount" with timeout 5000ms
      - waiting for locator('.items__listItem--step')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      53 -     // make sure the response is formatted as list items
      54 -     await test.step('response formatting', async () => {
    > 55 -       await expect(page.locator('.items__listItem--step')).not.toHaveCount(0);
         -                                                                ^
      56 -     });
      57 -
      58 -     await test.step('Reset chat', async () => {
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:55:64
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:54:16
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-interation-webkit-retry2/error-context.md
    
    1. [webkit] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ───────────
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-webkit/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-webkit-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-waiting-for-response-webkit-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-waiting-for-response-webkit-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toBeVisible() failed
    
    Locator: getByTestId('loading-indicator')
    Expected: visible
    Timeout: 5000ms
    Error: element(s) not found
    
    Call log:
      - Expect "toBeVisible" with timeout 5000ms
      - waiting for getByTestId('loading-indicator')
    
    
      75 -     await expect(page.getByTestId('loading-indicator')).not.toBeVisible();
      76 -     await page.getByTestId('submit-question-button').click();
    > 77 -     await expect(page.getByTestId('loading-indicator')).toBeVisible();
         -                                                         ^
      78 -     await expect(page.getByTestId('question-input')).not.toBeEnabled();
      79 -   });
      80 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:77:57
    
    Error Context: test-results/e2e-frontendchatapp-default-waiting-for-response-webkit-retry2/error-context.md
    
    1. [webkit] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history › chat history after chat
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-webkit/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-webkit-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-default-chat-history-webkit-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-default-chat-history-webkit-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).not.toHaveText(expected) failed
    
    Locator:  locator('.chat__txt--entry').last()
    Expected: not ""
    Received: ""
    Timeout:  5000ms
    
    Call log:
      - Expect "not toHaveText" with timeout 5000ms
      - waiting for locator('.chat__txt--entry').last()
        9 × locator resolved to <p class="chat__txt--entry">…</p>
          - unexpected value ""
    
    
      135 -
      136 -       const previousChatLastItem = chatHistory.nth(-1).locator('.chat__txt--entry').nth(-1);
    > 137 -       await expect(currentChat).not.toHaveText(lastChatText!);
          -                                     ^
      138 -       await expect(previousChatLastItem).toHaveText(lastChatText!);
      139 -     });
      140 -   });
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:137:37
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:115:5
    
    Error Context: test-results/e2e-frontendchatapp-default-chat-history-webkit-retry2/error-context.md
    
    1. [webkit] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ──────────────
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-webkit/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        8 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-webkit-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-citation-webkit-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-citation-webkit-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Error: expect(locator).toHaveCount(expected) failed
    
    Locator:  getByTestId('citation')
    Expected: 1
    Received: 0
    Timeout:  5000ms
    
    Call log:
      - Expect "toHaveCount" with timeout 5000ms
      - waiting for getByTestId('citation')
        9 × locator resolved to 0 elements
          - unexpected value "0"
    
    
      273 -   test('citation', async ({ page }) => {
      274 -     const citations = page.getByTestId('citation');
    > 275 -     await expect(citations).toHaveCount(1);
          -                             ^
      276 -
      277 -     await expect(citations.nth(0)).toBeEnabled();
      278 -     // if this test fails, change the citation source format to whatever is available
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:275:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-citation-webkit-retry2/error-context.md
    
    1. [webkit] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ───
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-webkit/error-context.md
    
    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-webkit-retry1/error-context.md
    
    attachment #2: trace (application/zip) ─────────────────────────────────────────────────────────
    test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-webkit-retry1/trace.zip
    Usage:
    
        npx playwright show-trace test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-webkit-retry1/trace.zip
    
    ────────────────────────────────────────────────────────────────────────────────────────────────
    
    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
    
    Test timeout of 30000ms exceeded.
    
    Error: locator.waitFor: Test timeout of 30000ms exceeded.
    Call log:
      - waiting for getByTestId('followUpQuestion') to be visible
    
    
      293 -   test('follow up questions', async ({ page }) => {
      294 -     const followupQuestions = page.getByTestId('followUpQuestion');
    > 295 -     await followupQuestions.waitFor();
          -                             ^
      296 -
      297 -     await expect(followupQuestions).toHaveCount(3);
      298 -
        at /workspaces/template/tests/e2e/frontendchatapp.spec.ts:295:29
    
    Error Context: test-results/e2e-frontendchatapp-generate-answer-follow-up-questions-webkit-retry2/error-context.md
    

    15 failed [chromium] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation ───────────────── [chromium] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ─────────── [chromium] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history ─────────────────── [chromium] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ────────────── [chromium] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ─── [firefox] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation ────────────────── [firefox] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ──────────── [firefox] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history ──────────────────── [firefox] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ─────────────── [firefox] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ──── [webkit] › tests/e2e/frontendchatapp.spec.ts:4:3 › default › chat interation ─────────────────── [webkit] › tests/e2e/frontendchatapp.spec.ts:65:3 › default › waiting for response ───────────── [webkit] › tests/e2e/frontendchatapp.spec.ts:81:3 › default › chat history ───────────────────── [webkit] › tests/e2e/frontendchatapp.spec.ts:273:3 › generate answer › citation ──────────────── [webkit] › tests/e2e/frontendchatapp.spec.ts:293:3 › generate answer › follow up questions ───── 15 passed (9.5m)

  • [x] azd down.

Security Requirements:

  • [x] Security scan is not performed.

ai-apps-bot avatar Apr 08 '25 04:04 ai-apps-bot