[py] CI tests are intermittently failing for pull requests [list of culprit tests]

[symonk]

What happened?

A fair few of the python tests in CI are a little flaky; resulting in red builds in most python pull requests at the minute; we are merging a few knowing they are 'flaky' so let's get that fixed up.

Edit: There are quite a few; here is a compiled lists of tests that suffer in CI; getting information for them all is pretty time consuming; but they could use some work. Some are harder to recreate than others and they could be due to latency in a CI system; most cases are hitting TimeoutErrors:

• ~test_full_virtual_authenticator (Todo: Add links)~ (fixed)
• test_click_should_timeout (Todo: Add links)
• test_should_timeout_on_page_load_taking_too_long (Todo: Add links)
• test_collect_log_mutations (BIDI/async) (Todo: Add links)
• test_should_be_able_to_click_element_that_is_out_of_view_in_aframe_that_is_out_of_view[chrome] output
• test_touch_pointer_properties - output

os: ubuntu 20.04 chromedriver: 100.0.4896.75 chrome: 100

[github-actions[bot]]

@symonk, thank you for creating this issue. We will troubleshoot it as soon as we can.

---

Info for maintainers

Triage this issue by using labels.

If information is missing, add a helpful comment and then I-issue-template label.

If the issue is a question, add the I-question label.

If the issue is valid but there is no time to troubleshoot it, consider adding the help wanted label.

If the issue requires changes or fixes from an external project (e.g., ChromeDriver, GeckoDriver, W3C), add the applicable G-* label, and it will provide the correct link and auto-close the issue.

After troubleshooting the issue, please add the R-awaiting answer label.

Thank you!

[github-actions[bot]]

This issue is looking for contributors.

Please comment below or reach out to us through our IRC/Slack/Matrix channels if you are interested.

[symonk]

test_full_virtual_authenticator fails because it has a dependency on webauthn.io which is not stable; it errors occassionally during the test.

[SinghHrmn]

@symonk test_full_virtual_authenticator: (outdated)

[symonk]

Thanks @SinghHrmn

[nnrepos]

hey @symonk can you give some examples of failures in git actions? by looking at the actions of the last few days, i only see tox-lint fail in selenium/webdriver/firefox/firefox_binary.py. thanks 😄

[github-actions[bot]]

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.