Cluster creation failing: Maybe due to using http://packages.cloud.google.com/apt?

[stevenhorsman]

I tried creating a cluster (on a standard x86 Ubuntu 22.04 machine) today and hit errors:

scp: /etc/kubernetes/admin.conf: No such file or directory
peer-pods-ctlplane-0 deployed on local
Deploying workers
Deploying Vms...
peer-pods-worker-0 deployed on local
Kubernetes cluster peer-pods deployed!!!
INFO export KUBECONFIG=$HOME/.kcli/clusters/peer-pods/auth/kubeconfig
INFO export PATH=$PWD:$PATH
Adding app ingress
error: error validating "https://raw.githubusercontent.com/kubernetes/ingress-nginx/master/deploy/static/provider/baremetal/deploy.yaml": error validating data: failed to download openapi: Get "http://localhost:8080/openapi/v2?timeout=32s": dial tcp 127.0.0.1:8080: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false
Adding app autolabeller
error: error validating "https://raw.githubusercontent.com/karmab/autolabeller/main/autorules.yml": error validating data: failed to download openapi: Get "http://localhost:8080/openapi/v2?timeout=32s": dial tcp 127.0.0.1:8080: connect: connection refused; if you choose to ignore these errors, turn validation off with --validate=false

I tried using an older version of kcli incase there was an issue there, but same result. When I looked further up the output I saw:

Err:5 https://packages.cloud.google.com/apt kubernetes-xenial Release
  404  Not Found [IP: 142.251.129.46 443]

which I think is the cause. I the kata-containers community we starting hitting issues in our CI today due to the disappearance of the the kubernetes repo at http://packages.cloud.google.com/apt, which has been deprecated for a while IIUC: https://kubernetes.io/docs/tasks/administer-cluster/kubeadm/change-package-repository/. I think the answer might be to switch to pkgs.k8s.io instead.