kubekey icon indicating copy to clipboard operation
kubekey copied to clipboard

W1208 00:56:07.932402 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice

Open CYS158 opened this issue 3 weeks ago • 10 comments

What is version of KubeKey has the issue?

4.0.2

What is your os environment?

Rocky

KubeKey config file

apiVersion: kubekey.kubesphere.io/v1
kind: Config
spec:
  download:
    # if set as "cn", so that online downloads will try to use available domestic sources whenever possible.
    zone: "cn"
  kubernetes:
    kube_version: v1.34.2
    # helm binary
    helm_version: v3.19.2
  etcd:
    # etcd binary
    etcd_version: v3.6.6
  image_registry:
    # ========== image registry ==========
    keepalived_version: 2.0.20
    # ========== image registry: harbor ==========
    harbor_version: v2.10.1
    dockercompose_version: v2.20.3
    # ========== image registry: docker-registry ==========
    docker_registry_version: 2.8.3
    # ========== image registry ==========
  cri:
    # support: containerd,docker
    container_manager: containerd
    sandbox_image:
      tag: "3.9"
    # ========== cri ==========
    # crictl binary
    crictl_version: v1.34.0
    # ========== cri: docker ==========
    # docker binary
    docker_version: 24.0.7
    # cridockerd. Required when kube_version is greater than 1.24
    cridockerd_version: v0.3.1
    # ========== cri: containerd ==========
    # containerd binary
    containerd_version: v1.7.29
    # runc binary
    runc_version: v1.4.0
  cni:
    ipv6_support: false
    multus:
      image:
        tag: v4.3.0
    # ========== cni ==========
    # cni_plugins binary (optional)
    # cni_plugins_version: v1.2.0
    # ========== cni: calico ==========
    # calicoctl binary
    calico_version: v3.28.2
    # ========== cni: cilium ==========
    # cilium helm
    cilium_version: 1.18.3
    # ========== cni: kubeovn ==========
    # kubeovn helm
    kubeovn_version: 1.13.0
    # ========== cni: hybridnet ==========
    # hybridnet helm
    hybridnet_version: 0.6.8
  storage_class:
    # ========== storageclass ==========
    # ========== storageclass: local ==========
    local:
      provisioner_image:
        tag: 4.2.0
      linux_utils_image:
        tag: 4.2.0
    # ========== storageclass: nfs ==========
    # nfs provisioner helm version
    nfs_provisioner_version: 4.3.0
  dns:
    dns_image:
      tag: v1.12.1
    dns_cache_image:
      tag: 1.24.0
  image_manifests:
    - docker.io/calico/apiserver:v3.28.2
    - docker.io/calico/cni:v3.28.2
    - docker.io/calico/ctl:v3.28.2
    - docker.io/calico/csi:v3.28.2
    - docker.io/calico/kube-controllers:v3.28.2
    - docker.io/calico/node-driver-registrar:v3.28.2
    - docker.io/calico/node:v3.28.2
    - docker.io/calico/pod2daemon-flexvol:v3.28.2
    - docker.io/calico/typha:v3.28.2
    - docker.io/kubesphere/coredns:v1.12.1
    - docker.io/kubesphere/k8s-dns-node-cache:1.24.0
    - docker.io/kubesphere/kube-apiserver:v1.34.2
    - docker.io/kubesphere/kube-controller-manager:v1.34.2
    - docker.io/kubesphere/kube-proxy:v1.34.2
    - docker.io/kubesphere/kube-scheduler:v1.34.2
    - docker.io/kubesphere/pause:3.9
    - docker.io/openebs/linux-utils:4.2.0
    - docker.io/openebs/provisioner-localpv:4.2.0
    - quay.io/tigera/operator:v1.34.5
    - docker.io/library/haproxy:2.9.6-alpine

A clear and concise description of what happend.

Image

Relevant log output


Additional information

No response

CYS158 avatar Dec 08 '25 00:12 CYS158

we found this log in deployment openebs-localpv-provisioner its occured by this issue: https://github.com/openebs/openebs/issues/3925 in k3s , same issue is presented : https://github.com/k3s-io/k3s/issues/12399 and now ,openebs team seems they didn't finish this issue yet maybe i did't found all same warnings , could you please tell me which pod your log come from?

zuoxuesong-worker avatar Dec 08 '25 01:12 zuoxuesong-worker

kube-system/openebs-localpv-provisioner calico-system/calico-typha 2个都有这个告警出现

CYS158 avatar Dec 08 '25 01:12 CYS158

如果我不想部署openebs-localpv-provider 要如何处理呢?

CYS158 avatar Dec 08 '25 02:12 CYS158

#  storage_class:
    # ========== storageclass ==========
    # ========== storageclass: local ==========
#    local:
#      provisioner_image:
#        tag: 4.2.0
#      linux_utils_image:
#        tag: 4.2.0
    # ========== storageclass: nfs ==========
    # nfs provisioner helm version
#    nfs_provisioner_version: 4.3.0
# ========== 显式禁用 Local PV Provisioner 的配置 ==========
  addons:
    local-storage:
      enabled: false
#    - docker.io/openebs/linux-utils:4.2.0
#    - docker.io/openebs/provisioner-localpv:4.2.0

进行上面修改还是无效会自动部署

CYS158 avatar Dec 08 '25 02:12 CYS158

...
spec:
...
  storage_class:
    local:
      enable: false
      default: false
...

详情可以参考: https://github.com/kubesphere/kubekey/blob/main/builtin/core/roles/defaults/defaults/main/05-storage_class.yaml

zuoxuesong-worker avatar Dec 08 '25 03:12 zuoxuesong-worker

本地存储的问题已经处理,但是calico-system/calico-typha也是显示这个问题,升级到3.29.7版本也是一样,再升级上去这个告警问题没有了1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 不过产生了新的错误: time="2025-12-08T07:25:32Z" level=error msg="Timeout or abort while handling" URI=/apis/projectcalico.org/v3 auditID=778e4602-8e51-4e91-aaf8-cd469381c0ef error="" klog-logger=tigera-apiserver method=GET time="2025-12-08T07:25:32Z" level=error msg="Post-timeout activity" error="" klog-logger=tigera-apiserver method=GET path=/apis/projectcalico.org/v3 result="" timeElapsed="1.581µs"

Image Image

CYS158 avatar Dec 08 '25 07:12 CYS158

calico单独更新一个组件的话,应该是组件之间不兼容导致的错误,具体请咨询calico team。 需要提高calico版本的话,可以在创建集群时设置:

spec:
...
  cni:
    calico_version: v3.31.0 #仅供参考
...

即可安装更高版本的calico配套组件。 个人测试v3.31.0安装后不会出现上述问题

zuoxuesong-worker avatar Dec 08 '25 09:12 zuoxuesong-worker

谢谢 初步测试calico_version: v3.31.2,镜像配置3.29.7可以正常运行 原来calico_version: v3.29.7,镜像配置3.29.7 不行 原来calico_version: v3.31.2,镜像配置3.31.2 也不行

CYS158 avatar Dec 08 '25 10:12 CYS158

spec: ... cni: calico_version: v3.31.0 #仅供参考 ... 测试还是会报错,高于v3.29.7版本就会,但是低于该版本(含该版本)报:1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice Image

低于3.29.7 calico-system/calico-typha-6fb4769459-xwfk6报: 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 高于v3.29.7 calico-system/calico-apiserver-84cbbbbfdc-phv7p报: 2025-12-08 21:11:39.882errortime="2025-12-08T13:11:39Z" level=error msg="Post-timeout activity" error="" klog-logger=tigera-apiserver method=GET path=/apis/projectcalico.org/v3 result="" timeElapsed=702ns 2025-12-08 21:11:39.882errortime="2025-12-08T13:11:39Z" level=error msg="Timeout or abort while handling" URI=/apis/projectcalico.org/v3 auditID=c97909ab-92af-48f5-89e5-db127173696c error="" klog-logger=tigera-apiserver method=GET

CYS158 avatar Dec 08 '25 13:12 CYS158

spec: ... cni: calico_version: v3.31.0 #仅供参考 ... 测试还是会报错,高于v3.29.7版本就会,但是低于该版本(含该版本)报:1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice Image

低于3.29.7 calico-system/calico-typha-6fb4769459-xwfk6报: 1 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 高于v3.29.7 calico-system/calico-apiserver-84cbbbbfdc-phv7p报: 2025-12-08 21:11:39.882errortime="2025-12-08T13:11:39Z" level=error msg="Post-timeout activity" error="" klog-logger=tigera-apiserver method=GET path=/apis/projectcalico.org/v3 result="" timeElapsed=702ns 2025-12-08 21:11:39.882errortime="2025-12-08T13:11:39Z" level=error msg="Timeout or abort while handling" URI=/apis/projectcalico.org/v3 auditID=c97909ab-92af-48f5-89e5-db127173696c error="" klog-logger=tigera-apiserver method=GET

看起来和 https://github.com/projectcalico/calico/issues/7791 这个有点像,应该是calico组件的问题

zuoxuesong-worker avatar Dec 09 '25 00:12 zuoxuesong-worker