kubeone icon indicating copy to clipboard operation
kubeone copied to clipboard

Test cluster provisioning on Nutanix - Test Release KubeOne 1.5

Open xmudrii opened this issue 3 years ago • 4 comments

This is a ticket for tracking the progress of testing cluster provisioning on Nutanix.

Follow instructions in #2232. Nutanix DOES NOT have automated E2E tests.

Use the following manifest as a template:

apiVersion: kubeone.k8c.io/v1beta2
kind: KubeOneCluster
versions:
  kubernetes: << VERSION >>
cloudProvider:
  nutanix: {}
addons:
  enable: true
  addons:
  - name: "default-storage-class"

Operating Systems to be tested:

  • [ ] Ubuntu 20.04
  • [ ] CentOS 7

Supported Kubernetes versions (choose only one operating system -- for example, you can test 1.24.3 on all operating systems, and then test other versions only on Ubuntu):

  • [ ] 1.24.3
  • [ ] 1.23.9
  • [ ] 1.22.12

OSM or legacy:

  • [ ] OSM
  • [ ] Legacy (machine-controller)

For each test, you should:

  • Create a Nutanix PV and attach it to the pod

xmudrii avatar Aug 07 '22 10:08 xmudrii

Test Cases

  • [x] Ubuntu 20.04 - 1.24.3 - OSM
  • [x] Ubuntu 20.04 - 1.23.9 - OSM
  • [x] Ubuntu 20.04 - 1.22.12 - OSM
  • [x] Ubuntu 20.04 - 1.24.3 - no OSM
  • [x] Ubuntu 20.04 - 1.23.9 - no OSM
  • [x] Ubuntu 20.04 - 1.22.12 - no OSM
  • [x] CentOS 7 - 1.24.3 - OSM
  • [x] CentOS 7 - 1.24.3 - no OSM

embik avatar Aug 16 '22 10:08 embik

Nutanix does not seem to be supported by OSM, but that's likely a bug.

embik avatar Aug 16 '22 10:08 embik

OSM issue was fixed (https://github.com/kubermatic/operating-system-manager/pull/209) and is available in quay.io/kubermatic/operating-system-manager:ef1a71d953a0aacddd530c09181c41a489dda593 build.

embik avatar Aug 16 '22 13:08 embik

I'm getting an error when trying to mount volumes:

MountVolume.SetUp failed for volume "pvc-c193a5d6-d72a-4abb-aad9-7d210bcd43a9" : rpc error: code = Internal desc = Operation timed out: Failed to update VG: [PUT /volume_groups/{uuid}][400] PutVolumeGroupsUUID default  &{APIVersion:3.1 Code:400 Kind: MessageList:[0xc00000e5b8] State:ERROR}

This was seemingly working when I tested without OSM, so need to investigate.

edit: fixed by https://github.com/kubermatic/operating-system-manager/pull/210.

embik avatar Aug 16 '22 14:08 embik

All scenarios passed conformance-lite and creating a PVC and mounting it into Pods (OSM needed to be on the latest commit to include the fixes mentioned above).

embik avatar Aug 18 '22 08:08 embik