cluster-api-provider-vsphere icon indicating copy to clipboard operation
cluster-api-provider-vsphere copied to clipboard

🌱 Fill up supervisor e2e test - clusterctl upgrades using ClusterClass

Open zhanggbj opened this issue 1 year ago • 22 comments
trafficstars

What this PR does / why we need it:

  • Enable test "When testing clusterctl upgrades using ClusterClass"

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged): Part of #2995

zhanggbj avatar May 24 '24 07:05 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

zhanggbj avatar May 27 '24 03:05 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-supervisor-main

zhanggbj avatar May 27 '24 05:05 zhanggbj

Test result indicated there's no CRD of AvailabilityZone, but I think this PR didn't touch AvailabilityZone or VMOperatorDependencies. Retry it...

/test pull-cluster-api-provider-vsphere-e2e-supervisor-main

  [FAILED] Failed to reconcile VMOperatorDependencies
  Unexpected error:
      <*errors.withStack | 0xc000620810>: 
      failed to get AvailabilityZone cluster-1: no matches for kind "AvailabilityZone" in version "topology.tanzu.vmware.com/v1alpha1"
      {
          error: <*errors.withMessage | 0xc000bab300>{
              cause: <*meta.NoKindMatchError | 0xc0011cc0c0>{
                  GroupKind: {
                      Group: "topology.tanzu.vmware.com",
                      Kind: "AvailabilityZone",
                  },
                  SearchedVersions: ["v1alpha1"],
              },
              msg: "failed to get AvailabilityZone cluster-1",
          },
          stack: [0x243e45b, 0xea9f32, 0xea9d87, 0xeaa238, 0x2438676, 0x249acfc, 0x228e8c7, 0xbac733, 0xbc07cd, 0x4741c1],
      }
  occurred
  In [It] at: /home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/test/e2e/e2e_setup_test.go:310 @ 05/27/24 06:11:19.972

zhanggbj avatar May 30 '24 09:05 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

zhanggbj avatar Jun 25 '24 07:06 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

chrischdi avatar Jun 25 '24 09:06 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

zhanggbj avatar Jun 26 '24 08:06 zhanggbj

Looks like the test failed due to missing StorageClass CRD, I didn't find out who's responsible for creating it. @chrischdi would you please help to take a look, thanks!

  [38;5;9m[FAILED] Failed to reconcile VMOperatorDependencies
  Unexpected error:
      <*errors.withStack | 0xc002889938>: 
      failed to get vm-operator StorageClass test-storageclass: no kind is registered for the type v1.StorageClass in scheme "pkg/runtime/scheme.go:100"
      {
          error: <*errors.withMessage | 0xc000461220>{
              cause: <*runtime.notRegisteredErr | 0xc002a88de0>{
                  schemeName: "pkg/runtime/scheme.go:100",
                  gvk: {Group: "", Version: "", Kind: ""},
                  target: nil,
                  t: <*reflect.rtype | 0x2f070a0>{
                      t: {Size_: 0x168, PtrBytes: 0x158, Hash: 4276623934, TFlag: 7, Align_: 8, FieldAlign_: 8, Kind_: 25, Equal: nil, GCData: 85, Str: 252249, PtrToThis: 10592864},
                  },
              },
              msg: "failed to get vm-operator StorageClass test-storageclass",
          },
          stack: [0x25997df, 0xf2ad12, 0xf2ab6d, 0xf2b025, 0x2592548, 0x2602105, 0x23de878, 0xc27db3, 0xc3bf6d, 0x47b361],
      }
  occurred[0m
  [38;5;9mIn [1m[It][0m[38;5;9m at: [1m/home/prow/go/src/sigs.k8s.io/cluster-api-provider-vsphere/test/e2e/e2e_setup_test.go:331[0m [38;5;243m@ 06/26/24 08:21:09.139[0m

zhanggbj avatar Jun 26 '24 10:06 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

zhanggbj avatar Jun 28 '24 03:06 zhanggbj

/test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main

zhanggbj avatar Jun 28 '24 05:06 zhanggbj

We need

  • https://github.com/kubernetes-sigs/cluster-api-provider-vsphere/blob/1feaf6a9572b97e003990f4de52112d2a97f7367/test/e2e/data/infrastructure-vsphere-govmomi/v1.10 but for supervisor
  • entries like https://github.com/kubernetes-sigs/cluster-api-provider-vsphere/blob/1feaf6a9572b97e003990f4de52112d2a97f7367/Makefile#L402-L403
  • and reference the created files in the vsphere.yaml

Weird error for govmomi, maybe this was due to their maintenance.

/test pull-cluster-api-provider-vsphere-e2e-govmomi-main

chrischdi avatar Jun 28 '24 06:06 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-main

Could have been related to NSX-T maintenance

chrischdi avatar Jun 28 '24 12:06 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-main

was related to thumbprint change to sha256, changed back to sha1

chrischdi avatar Jun 28 '24 13:06 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main

chrischdi avatar Jul 02 '24 05:07 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

chrischdi avatar Jul 02 '24 13:07 chrischdi

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main

chrischdi avatar Jul 02 '24 17:07 chrischdi

/lgtm

chrischdi avatar Jul 02 '24 17:07 chrischdi

LGTM label has been added.

Git tree hash: 6cb3bc05a996ca67a1816bab3499c0755a6badb2

k8s-ci-robot avatar Jul 02 '24 17:07 k8s-ci-robot

Many thanks to @chrischdi for your help and great work on this!

zhanggbj avatar Jul 03 '24 03:07 zhanggbj

Needs a rebase :D

chrischdi avatar Jul 03 '24 12:07 chrischdi

We should probably also squash the commits when we rebase. I think merge commits in PRs were not good (I don't remember the reason)

sbueringer avatar Jul 04 '24 14:07 sbueringer

/retest

sbueringer avatar Jul 05 '24 09:07 sbueringer

/test ?

sbueringer avatar Jul 05 '24 09:07 sbueringer

@sbueringer: The following commands are available to trigger required jobs:

  • /test pull-cluster-api-provider-vsphere-e2e-govmomi-blocking-main
  • /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main
  • /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main
  • /test pull-cluster-api-provider-vsphere-e2e-govmomi-main
  • /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main
  • /test pull-cluster-api-provider-vsphere-e2e-supervisor-blocking-main
  • /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main
  • /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main
  • /test pull-cluster-api-provider-vsphere-e2e-supervisor-main
  • /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main
  • /test pull-cluster-api-provider-vsphere-e2e-vcsim-govmomi-main
  • /test pull-cluster-api-provider-vsphere-e2e-vcsim-supervisor-main
  • /test pull-cluster-api-provider-vsphere-test-main
  • /test pull-cluster-api-provider-vsphere-verify-main

The following commands are available to trigger optional jobs:

  • /test pull-cluster-api-provider-vsphere-apidiff-main
  • /test pull-cluster-api-provider-vsphere-janitor-main

Use /test all to run the following jobs that were automatically triggered:

  • pull-cluster-api-provider-vsphere-apidiff-main
  • pull-cluster-api-provider-vsphere-e2e-govmomi-blocking-main
  • pull-cluster-api-provider-vsphere-e2e-supervisor-blocking-main
  • pull-cluster-api-provider-vsphere-test-main
  • pull-cluster-api-provider-vsphere-verify-main

In response to this:

/test ?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

k8s-ci-robot avatar Jul 05 '24 09:07 k8s-ci-robot

/test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-conformance-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-govmomi-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-ci-latest-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-conformance-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-main /test pull-cluster-api-provider-vsphere-e2e-supervisor-upgrade-1-30-1-31-main /test pull-cluster-api-provider-vsphere-e2e-vcsim-govmomi-main /test pull-cluster-api-provider-vsphere-e2e-vcsim-supervisor-main

sbueringer avatar Jul 05 '24 09:07 sbueringer

@chrischdi Let's merge once tests are green

/lgtm /approve

/hold

sbueringer avatar Jul 05 '24 09:07 sbueringer

LGTM label has been added.

Git tree hash: 5edc17e517eb5615c63dfacb7b0c2a3d2239fc34

k8s-ci-robot avatar Jul 05 '24 09:07 k8s-ci-robot

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: sbueringer

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment Approvers can cancel approval by writing /approve cancel in a comment

k8s-ci-robot avatar Jul 05 '24 09:07 k8s-ci-robot

/hold cancel

sbueringer avatar Jul 05 '24 10:07 sbueringer