Test cluster provisioning on Nutanix - Test Release KubeOne 1.5
This is a ticket for tracking the progress of testing cluster provisioning on Nutanix.
Follow instructions in #2232. Nutanix DOES NOT have automated E2E tests.
Use the following manifest as a template:
apiVersion: kubeone.k8c.io/v1beta2
kind: KubeOneCluster
versions:
kubernetes: << VERSION >>
cloudProvider:
nutanix: {}
addons:
enable: true
addons:
- name: "default-storage-class"
Operating Systems to be tested:
- [ ] Ubuntu 20.04
- [ ] CentOS 7
Supported Kubernetes versions (choose only one operating system -- for example, you can test 1.24.3 on all operating systems, and then test other versions only on Ubuntu):
- [ ] 1.24.3
- [ ] 1.23.9
- [ ] 1.22.12
OSM or legacy:
- [ ] OSM
- [ ] Legacy (machine-controller)
For each test, you should:
- Create a Nutanix PV and attach it to the pod
Test Cases
- [x] Ubuntu 20.04 - 1.24.3 - OSM
- [x] Ubuntu 20.04 - 1.23.9 - OSM
- [x] Ubuntu 20.04 - 1.22.12 - OSM
- [x] Ubuntu 20.04 - 1.24.3 - no OSM
- [x] Ubuntu 20.04 - 1.23.9 - no OSM
- [x] Ubuntu 20.04 - 1.22.12 - no OSM
- [x] CentOS 7 - 1.24.3 - OSM
- [x] CentOS 7 - 1.24.3 - no OSM
Nutanix does not seem to be supported by OSM, but that's likely a bug.
OSM issue was fixed (https://github.com/kubermatic/operating-system-manager/pull/209) and is available in quay.io/kubermatic/operating-system-manager:ef1a71d953a0aacddd530c09181c41a489dda593 build.
I'm getting an error when trying to mount volumes:
MountVolume.SetUp failed for volume "pvc-c193a5d6-d72a-4abb-aad9-7d210bcd43a9" : rpc error: code = Internal desc = Operation timed out: Failed to update VG: [PUT /volume_groups/{uuid}][400] PutVolumeGroupsUUID default &{APIVersion:3.1 Code:400 Kind: MessageList:[0xc00000e5b8] State:ERROR}
This was seemingly working when I tested without OSM, so need to investigate.
edit: fixed by https://github.com/kubermatic/operating-system-manager/pull/210.
All scenarios passed conformance-lite and creating a PVC and mounting it into Pods (OSM needed to be on the latest commit to include the fixes mentioned above).