cert-manager-operator icon indicating copy to clipboard operation
cert-manager-operator copied to clipboard

MULTIARCH-3780: Added Test Case Modification for IBMCloud and Power

Open pranitaT opened this issue 1 year ago • 20 comments

Issue: https://issues.redhat.com/browse/MULTIARCH-3780 updated https://github.com/openshift/cert-manager-operator/blob/master/test/e2e/certificates_test.go

Added new tests:

  • dns-01 challenge using explicit credentials on ibm cloud CIS

Modified existing tests:

  • dns-01 challenge using explicit credentials
  • dns-01 challenge using ambient credentials

pranitaT avatar Jan 03 '24 12:01 pranitaT

Hi @pranitaT. Thanks for your PR.

I'm waiting for a openshift member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

openshift-ci[bot] avatar Jan 03 '24 12:01 openshift-ci[bot]

@lunarwhite @geliu2016 would you like to also help review when available?

xingxingxia avatar Jan 04 '24 02:01 xingxingxia

@pranitaT: This pull request references MULTIARCH-3780 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "4.16.0" version, but no target version was set.

In response to this:

Issue: https://issues.redhat.com/browse/MULTIARCH-3780 updated https://github.com/openshift/cert-manager-operator/blob/master/test/e2e/certificates_test.go

Added new tests:

  • dns-01 challenge using explicit credentials on ibm cloud CIS
  • dns-01 challenge using ambient credentials on ibm cloud CIS

Modified existing tests:

  • dns-01 challenge using explicit credentials
  • dns-01 challenge using ambient credentials

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Jan 04 '24 04:01 openshift-ci-robot

If I'm not wrong, we don't have CI setup to run tests on IBM Power yet. Are there any plans to also add CI as follow-up PRs? also cc: @swghosh

chiragkyal avatar Jan 04 '24 08:01 chiragkyal

If I'm not wrong, we don't have CI setup to run tests on IBM Power yet. Are there any plans to also add CI as follow-up PRs?

Yeah, we dunno have any plans to add CI runs for IBM P/Z systems atleast for now (we can probably look that up in future). However, these tests are intended to be skipped in the normal CI runs which we have for AWS clusters in our current jobs; so it should ideally be really similar to what is being done for GCP in #166. I believe QE intends to run these tests independently in own infra where the necessary cloud provider is available.

Nevertheless, over time we can grow test cases in this same repo and use filters to run e2e tests (i.e. continue to use test/e2e as single source of all e2e cases; irrespective of what's run on pre-sumbits) effectively per platform.

swghosh avatar Jan 04 '24 08:01 swghosh

Hey @chiragkyal

If I'm not wrong, we don't have CI setup to run tests on IBM Power yet. Are there any plans to also add CI as follow-up PRs?

That's right

Yeah, we dunno have any plans to add CI runs for IBM P/Z systems atleast for now (we can probably look that up in future). However, these tests are intended to be skipped in the normal CI runs which we have for AWS clusters in our current jobs; so it should ideally be really similar to what is being done for GCP in https://github.com/openshift/cert-manager-operator/pull/166. I believe QE intends to run these tests independently in own infra where the necessary cloud provider is available.

@swghosh we are looking at enabling it as soon as possible.

Thanks

Paul

prb112 avatar Jan 05 '24 20:01 prb112

/ok-to-test

chiragkyal avatar Jan 08 '24 15:01 chiragkyal

/retest

prb112 avatar Jan 19 '24 17:01 prb112

HI @lunarwhite your comments should be addressed, if acceptable, please let us know. Thank you. Paul

prb112 avatar Jan 24 '24 18:01 prb112

@pranitaT: This pull request references MULTIARCH-3780 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the task to target the "4.16.0" version, but no target version was set.

In response to this:

Issue: https://issues.redhat.com/browse/MULTIARCH-3780 updated https://github.com/openshift/cert-manager-operator/blob/master/test/e2e/certificates_test.go

Added new tests:

  • dns-01 challenge using explicit credentials on ibm cloud CIS

Modified existing tests:

  • dns-01 challenge using explicit credentials
  • dns-01 challenge using ambient credentials

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Mar 21 '24 08:03 openshift-ci-robot

/jira refresh

prb112 avatar Mar 21 '24 14:03 prb112

@prb112: This pull request references MULTIARCH-3780 which is a valid jira issue.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

openshift-ci-robot avatar Mar 21 '24 14:03 openshift-ci-robot

Hey @swghosh Pranita has addressed the code comments, and I have responded in threads to specific points. Please let us know if you need anymore details for the review. Thank you Paul

prb112 avatar Mar 21 '24 14:03 prb112

Hi @swghosh I've updated the branch. Please review the changes. Thank you

pranitaT avatar Mar 22 '24 09:03 pranitaT

/test all

swghosh avatar Apr 05 '24 17:04 swghosh

/approve

prb112 avatar Apr 12 '24 14:04 prb112

/cc @TrilokGeer FYI, improvements regarding modularization of test case structure for different cloud providers can be follow-ed up in CM-261.

swghosh avatar Apr 15 '24 07:04 swghosh

Hi @TrilokGeer thoughts on this code? thanks, Paul

prb112 avatar Apr 30 '24 17:04 prb112

/test fips-image-scan

prb112 avatar May 30 '24 12:05 prb112

@prb112 would need https://github.com/openshift/cert-manager-operator/pull/185 to land first in order for that fips-image-scan test to turn green.

swghosh avatar May 30 '24 12:05 swghosh

Got it. thanks @swghosh

prb112 avatar May 30 '24 12:05 prb112

/test all

swghosh avatar May 30 '24 13:05 swghosh

Hi @TrilokGeer Hope all is well. back to you for review, Paul

prb112 avatar Jun 24 '24 18:06 prb112

/test fips-image-scan

swghosh avatar Jun 25 '24 14:06 swghosh

Hey Swarup, do we need to rebase for this test to pass? Thanks, Paul

prb112 avatar Jun 25 '24 17:06 prb112

/test fips-image-scan

prb112 avatar Jul 12 '24 19:07 prb112

Hey @TrilokGeer please take a look, thanks, Paul

prb112 avatar Jul 12 '24 19:07 prb112

/lgtm

swghosh avatar Jul 15 '24 16:07 swghosh

/lgtm /approve

TrilokGeer avatar Jul 16 '24 00:07 TrilokGeer

/label docs-approved /label px-approved These are non-user facing changes to e2e test cases only. Multi-arch operator already landed in 1.13+.

swghosh avatar Jul 16 '24 06:07 swghosh