client icon indicating copy to clipboard operation
client copied to clipboard

Fix wait-loop in domain E2E test

Open dsimansk opened this issue 1 year ago • 15 comments

Description

Changes

  • Add trim to domain wait loop

There's an ongoing intermittent failure that causing flaked E2E tests. The wait loop doesn't seem to be very effective to prevent those. Trying to add simple string trim. Any other ideas are welcome. :)

/cc @rhuss

Reference

Fixes #1873

Release Note

Fix wait-loop in domain E2E test

dsimansk avatar Mar 14 '24 09:03 dsimansk

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 74.58%. Comparing base (03e5516) to head (ddd343c). Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1919   +/-   ##
=======================================
  Coverage   74.58%   74.58%           
=======================================
  Files         207      207           
  Lines       15563    15563           
=======================================
  Hits        11607    11607           
  Misses       3167     3167           
  Partials      789      789           

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar Mar 14 '24 09:03 codecov[bot]

/test all

dsimansk avatar Mar 14 '24 10:03 dsimansk

/test integration-tests-latest-release_client_main

dsimansk avatar Mar 14 '24 12:03 dsimansk

/test integration-tests-latest-release_client_main /integration-tests_client_main

dsimansk avatar Mar 14 '24 13:03 dsimansk

It seems to be more stable, might be really a matter of sanitizing the string before in the wait loop then.

dsimansk avatar Mar 14 '24 13:03 dsimansk

For a quick comparison the other PR run into the issue with flake immediately, https://github.com/knative/client/pull/1920.

dsimansk avatar Mar 14 '24 13:03 dsimansk

/test all

dsimansk avatar Mar 14 '24 14:03 dsimansk

@rhuss with the recent run it's not really fixing anything, just a placebo. I'll try to debug it further.

dsimansk avatar Mar 15 '24 12:03 dsimansk

@rhuss found it per https://github.com/knative/client/pull/1919/commits/8e7539126635472cbac3f31605e58ba7c750c41b.

dsimansk avatar Mar 15 '24 14:03 dsimansk

There's potentially another flake unrelated to domain wait loop.

https://prow.knative.dev/view/gs/knative-prow/pr-logs/pull/knative_client/1919/integration-tests-latest-release_client_main/1768652899295956992#1:build-log.txt%3A905

dsimansk avatar Mar 15 '24 15:03 dsimansk

/retest

dsimansk avatar Mar 15 '24 15:03 dsimansk

/retest

dsimansk avatar Mar 19 '24 09:03 dsimansk

/retest

dsimansk avatar Mar 19 '24 15:03 dsimansk

/approve /lgtm

rhuss avatar Mar 27 '24 09:03 rhuss

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dsimansk, rhuss

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

knative-prow[bot] avatar Mar 27 '24 09:03 knative-prow[bot]

/unhold

dsimansk avatar Mar 27 '24 10:03 dsimansk