[BUG] M1 visual regression bug, navigation failed because page crashed

[PascalvdHoek]

Describe the bug

This is the third time I submit this issue, All closed and solved, but I still get the error. Hasn't solved it for me. Are there any updates when It will be solved?

https://github.com/microsoft/playwright/issues/13722 https://github.com/microsoft/playwright/issues/13871 merged into https://github.com/microsoft/playwright/issues/14236

Repros:

• https://github.com/PascalvdHoek/angular-playwright-bug

[mxschmitt]

First, sorry for the trouble and that the software is not working as intended!

The first issue was closed because we didn't get any repro. For the second it was merged into the third, not sure if it's the same tho. And the third was fixed recently (ssl not working on webkit, linux, arm).

Could you try using the development build? npm i @playwright/test@next to see if your issue is still persistent with the changes which get included in 1.23.

Can you confirm that you still have the same issue as in https://github.com/microsoft/playwright/issues/13871 with the same kind of project? Then I'd reopen https://github.com/microsoft/playwright/issues/13871 instead.

Unfortunately not a lot of people ran into it and having a linux/arm issue is not always easy to reproduce since it requires M1 notebooks.

[PascalvdHoek]

Is there also a docker image available with this version?

[PascalvdHoek]

Still got the issue with the v1.24.0-alpha-jul-5-2022

[aslushnikov]

This does look like a bug; I was able to repro.

[thebspin]

I still have this issue running 1.25.2 in my package and docker container

[PascalvdHoek]

@aslushnikov @dgozman @mxschmitt Any updates on this issue? or any tracks on where maybe the issue occurs? So I can do some research myself as well. But dunno where to start

[mxschmitt]

We already invested a few hours into debugging this issue. So here are some general debugging tips and direction where we should go:

• Create a more minimal example, try to understand what's required that the page crashes
• Set the DEBUG=pw:browser,pw:protocol env var to see what the protocol gives us, most likely just crashed: true

I unfortunately don't have a m1, so i can't look into it since its m1 specific.

[pencilcheck]

on m1, also crash on webkit when running playwright in docker

[rickvandermey]

It seems like there is some progression, since 1.27.1 some of test are passing, others are failing. When looking specific at which test succeeds and which fails, the webkit version is not stable.

All chromium related test are successful

some of the desktop-webkit fails, and most of the iphone-11-webkit fails

{
	name: 'desktop-webkit',
	use: { ...devices['Desktop Safari'], deviceScaleFactor: 1 },
},
{
	name: 'iphone-11-webkit',
	use: { ...devices['iPhone 11'] },
},

still using version 1.19.0 whereas here all tests are successful

[mxschmitt]

I can verify that this will be fixed in 1.29. You can wait until tomorrow and consume it via the canary releases: https://playwright.dev/docs/canary-releases