bottlerocket-os
vmware images are using a removed argument for api-server cloud-provider=external
Image I'm using: bottlerocket-v1.33.5-kubernetes-1-33-eks-17-amd64-a5ca614
What I expected to happen: (EKSA) Update to go as expected, with all services starting
What actually happened: Found node wouldn't become ready, looked at the pods and found an error in the logs:
macintoshme@werk ~ k logs kube-apiserver-dvlp-workload-bdb7h
Error: unknown flag: --cloud-provider
How to reproduce the problem: I am very surprised no one else has run into this as it appears to affect all vmware 1.33 clusters:
Found what appears to be the offending lines:
https://github.com/bottlerocket-os/bottlerocket/blob/79b1eceaaf819c19ad906d460824a4325f935205/sources/shared-defaults/kubernetes-vmware.toml#L7
https://github.com/bottlerocket-os/bottlerocket/blob/79b1eceaaf819c19ad906d460824a4325f935205/sources/shared-defaults/kubernetes-aws-external-cloud-provider.toml#L2
This was removed in 1.31, but I think it wasn't an issue until they actually removed it from kubernetes later.
