element-web icon indicating copy to clipboard operation
element-web copied to clipboard

Flaky playwright test: `crypto/event-shields.spec.ts: should show correct shields on events sent by devices which have since been deleted`

Open RiotRobot opened this issue 1 year ago • 27 comments

https://github.com/element-hq/matrix-react-sdk/actions/runs/10908576705

RiotRobot avatar Sep 17 '24 18:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10919174293

RiotRobot avatar Sep 18 '24 09:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10919624690

RiotRobot avatar Sep 18 '24 09:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10937689615

RiotRobot avatar Sep 19 '24 09:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10938679884

RiotRobot avatar Sep 19 '24 10:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10944560453

RiotRobot avatar Sep 19 '24 16:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/10992656361

RiotRobot avatar Sep 23 '24 10:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11034447584

RiotRobot avatar Sep 25 '24 14:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11054600607

RiotRobot avatar Sep 26 '24 14:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11108175970

RiotRobot avatar Sep 30 '24 14:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11110803603

RiotRobot avatar Sep 30 '24 17:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11110825464

RiotRobot avatar Sep 30 '24 17:09 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11125667597

RiotRobot avatar Oct 01 '24 13:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11175849515

RiotRobot avatar Oct 04 '24 07:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11232565367

RiotRobot avatar Oct 08 '24 09:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11233921980

RiotRobot avatar Oct 08 '24 11:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11235210852

RiotRobot avatar Oct 08 '24 12:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11257608084

RiotRobot avatar Oct 09 '24 15:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11264342274

RiotRobot avatar Oct 09 '24 23:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11269690192

RiotRobot avatar Oct 10 '24 08:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11276085267

RiotRobot avatar Oct 10 '24 14:10 RiotRobot

https://github.com/element-hq/matrix-react-sdk/actions/runs/11276849979

RiotRobot avatar Oct 10 '24 15:10 RiotRobot

This has flaked twice in a row for me. If nobody has time to look, I think we'll have to disable it.

dbkr avatar Oct 10 '24 17:10 dbkr

ftr, this is:

https://e2e-131--matrix-react-sdk.netlify.app/#?testId=549c35dde3453c6f6198-53d1af2a964b4d8c9a63

Error: jsHandle.evaluate: Error: Cannot encrypt event in unconfigured room !wDXBgADKUDbRHIRBhX:localhost

    at RustCrypto.encryptEvent (http://localhost:8080/bundles/94c04cf2a65f14e9f347/771.js:3276:13)
    at MatrixClient.encryptEventIfNeeded (http://localhost:8080/bundles/94c04cf2a65f14e9f347/init.js:9339:30)
    at async MatrixClient.encryptAndSendEvent (http://localhost:8080/bundles/94c04cf2a65f14e9f347/init.js:9271:9)
    at async <anonymous>:260:30
    at RustCrypto.encryptEvent (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/94c04cf2a65f14e9f347/771.js:3276:13)
    at MatrixClient.encryptEventIfNeeded (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/94c04cf2a65f14e9f347/init.js:9339:30)
    at async MatrixClient.encryptAndSendEvent (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/http:/localhost:8080/bundles/94c04cf2a65f14e9f347/init.js:9271:9)
    at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/async <anonymous>:260:30
    at Bot.sendMessage (/home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/pages/client.ts:125:23)
    at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/event-shields.spec.ts:276:13

ie. the bot client is failing to send a message into the room because it's not ready yet, so probably needs more waiting on the bot side?

dbkr avatar Oct 10 '24 17:10 dbkr

https://github.com/element-hq/matrix-react-sdk/actions/runs/11360236274

RiotRobot avatar Oct 16 '24 06:10 RiotRobot

ugh.

  3) crypto/event-shields.spec.ts:273:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted 
    Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()

    Locator: locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon')
    Expected: not visible
    Received: visible
    Call log:
      - expect.not.toBeVisible with timeout 5000ms
      - waiting for locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon')
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"
      -   locator resolved to <div tabindex="0" aria-labelledby="floating-ui-248" aria-label="State of the end-to-end encryption" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div>
      -   unexpected value "visible"


      306 |
      307 |             const penultimate = page.locator(".mx_EventTile").filter({ hasText: "test encrypted from verified" });
    > 308 |             await expect(penultimate.locator(".mx_EventTile_e2eIcon")).not.toBeVisible();
          |                                                                            ^
      309 |         });
      310 |     });
      311 | });

        at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/event-shields.spec.ts:308:76

It's a different failure mode to before.

richvdh avatar Oct 16 '24 10:10 richvdh

https://github.com/element-hq/element-web/actions/runs/11389048513

RiotRobot avatar Oct 17 '24 16:10 RiotRobot

https://github.com/element-hq/element-web/actions/runs/11437982011

RiotRobot avatar Oct 21 '24 10:10 RiotRobot

https://github.com/element-hq/element-web/actions/runs/11500478569

RiotRobot avatar Oct 24 '24 13:10 RiotRobot

https://github.com/element-hq/element-web/actions/runs/11556287070

RiotRobot avatar Oct 28 '24 14:10 RiotRobot

https://github.com/element-hq/element-web/actions/runs/11557477002

RiotRobot avatar Oct 28 '24 15:10 RiotRobot