element-web icon indicating copy to clipboard operation
element-web copied to clipboard

Flaky playwright test: `room/create-room.spec.ts: should create a public room with name, topic & address set`

Open RiotRobot opened this issue 2 weeks ago • 25 comments

https://github.com/element-hq/element-web/actions/runs/19955214266

Image

RiotRobot avatar Dec 05 '25 07:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/19958902188

RiotRobot avatar Dec 05 '25 10:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/19961793582

RiotRobot avatar Dec 05 '25 11:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/19962620123

RiotRobot avatar Dec 05 '25 12:12 RiotRobot

Oh how wonderful they are auto reported nowadays! Was about to mention this flaky test.

toger5 avatar Dec 05 '25 13:12 toger5

https://github.com/element-hq/element-web/actions/runs/19971606036

RiotRobot avatar Dec 05 '25 18:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/19975189705

RiotRobot avatar Dec 05 '25 20:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20026666925

RiotRobot avatar Dec 08 '25 11:12 RiotRobot

failed three times in a row on https://github.com/element-hq/element-web/actions/runs/20028469894/job/57431718093?pr=31448

Seems something has caused this to regress recently

richvdh avatar Dec 08 '25 13:12 richvdh

@toger5: they are only auto-reported if they pass when retried. If they flake three times in a row (i.e., they make your build fail), you'll still need to report the fail manually.

(In other words: ironically, the most-flaky tests are not autoreported)

richvdh avatar Dec 08 '25 13:12 richvdh

https://github.com/element-hq/element-web/actions/runs/20038100303

RiotRobot avatar Dec 08 '25 18:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20071975979

RiotRobot avatar Dec 09 '25 17:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20072759165

RiotRobot avatar Dec 09 '25 17:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20075970496

RiotRobot avatar Dec 09 '25 19:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20077869456

RiotRobot avatar Dec 09 '25 21:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20078359031

RiotRobot avatar Dec 09 '25 22:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20090019176

RiotRobot avatar Dec 10 '25 07:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20096207692

RiotRobot avatar Dec 10 '25 11:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20105673820

RiotRobot avatar Dec 10 '25 16:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20108637362

RiotRobot avatar Dec 10 '25 18:12 RiotRobot

The top line of the 'topic' box is missing.

Expected/actual Image

t3chguy avatar Dec 11 '25 10:12 t3chguy

@t3chguy suggest adding that to the description so it doesn't get lost in the comment spam from @RiotRobot

richvdh avatar Dec 11 '25 10:12 richvdh

https://github.com/element-hq/element-web/actions/runs/20131797737

RiotRobot avatar Dec 11 '25 11:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20133426814

RiotRobot avatar Dec 11 '25 12:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20134010481

RiotRobot avatar Dec 11 '25 13:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20163150600

RiotRobot avatar Dec 12 '25 10:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20188329290

RiotRobot avatar Dec 13 '25 07:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20223209766

RiotRobot avatar Dec 15 '25 07:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20228630345

RiotRobot avatar Dec 15 '25 10:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20238912216

RiotRobot avatar Dec 15 '25 16:12 RiotRobot

https://github.com/element-hq/element-web/actions/runs/20240493188

RiotRobot avatar Dec 15 '25 17:12 RiotRobot