agent-js-playwright icon indicating copy to clipboard operation
agent-js-playwright copied to clipboard

Tests exceeding playwright timeout and retrying are interrupted and RP launch runs forever

Open noacohen1 opened this issue 1 year ago • 5 comments

Hi, Im using "@reportportal/agent-js-playwright": "^5.1.4" and "@playwright/test": "^1.41.1" I experience the following behavior: When i have a test that for instance seraches a locator and exceeds the playwright timeout while waiting, the 1 attempt obviusly failes like in here: image

Then the test tries to perform a retry but the status is interrupted immidiatly, like in here: image

And the whole launch is stuck on this test, even though the state is failed...

Screenshot 2024-02-01 at 14 57 42

noacohen1 avatar Feb 01 '24 13:02 noacohen1

Hello @noacohen1 ! Do you see any errors in the console? Could you please also share an example to help us reproduce the issue on our end?

AmsterGet avatar Feb 01 '24 13:02 AmsterGet

Which console are you refering? those tests aren't running locally, they tun on a machine and in the machine logs the tests fails after a timeout and continue to the next test. it's a long test that involves many files, i can paste here the main test function: image

this is the part where the interrupted is thrown and the timeout exceeds: image

noacohen1 avatar Feb 01 '24 14:02 noacohen1

The issue here is that the locator is not correct and the 'target' element couldn't be found. But I don't expect the launch to be interrupted and behave this way. i expect the test in this launch to fail.

noacohen1 avatar Feb 04 '24 09:02 noacohen1

Hi i still have this timeout issue, this time i have a test that waits for timeout (playwright method) image

This test is stuck for 8 hours...

image

This launch is still "running" even though all of the tests have passed. Is it possible that in this package there's a bug regarding playwright timeouts and report portal not knowing that the timeout has been reached? image

noacohen1 avatar Feb 06 '24 08:02 noacohen1

Hi @noacohen1 ! Thank you for additional details. We have previously fixed several issues related to Playwright timeouts, but it seems that not all cases have been fixed yet. Unfortunately, we don't have enough team capacity to dive into this issue at this time. We would appreciate it if you could provide a small set of tests and configuration that we can run to reproduce the issue as soon as we have enough time.

AmsterGet avatar Feb 06 '24 10:02 AmsterGet