Can not access Grafana and Prometheus after the upgrade to lastest vesion

[xqdada]

What happened?

When Installed Kube-Promeheus of lastest version，I can not access Grafana and Prometheus with curl in centos.but use the following commands are fine.

 kubectl port-forward --address 0.0.0.0 svc/grafana 32166:3000 -n monitoring

as a result:

Did you expect to see some different?

I can access Grafana for http://pod_ip:3000 or http://svc_ip:3000.for example:

curl 10.20.184.151:3000 #Pod IP
curl 10.68.209.245:3000 #Service IP

How to reproduce it (as minimally and precisely as possible):

Use the same environment to installed it.

Environment

• Prometheus Operator version:

main branch and commit id (7d4529d3d73f5bad885a65ff4c28c6f7baec2378)

• Kubernetes version information:

  kubectl version

Client Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.0", GitCommit:"b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d", GitTreeState:"clean", BuildDate:"2022-12-08T19:58:30Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"26", GitVersion:"v1.26.0", GitCommit:"b46a3f887ca979b1a5d14fd39cb1af43e7e5d12d", GitTreeState:"clean", BuildDate:"2022-12-08T19:51:45Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/amd64"}

• Kubernetes cluster kind:

ansible

• Prometheus Operator Logs:

• Prometheus Logs:

Anything else we need to know?: calico version: v3.24.5

Pinging the Pod IP of other namespace from node is work . so It's probably not network problem.

ansible all  -i clusters/scm/hosts -m command -a 'ping -c 1 10.20.9.191'|grep rc=0
---
172.20.5.13 | CHANGED | rc=0 >>
172.20.5.12 | CHANGED | rc=0 >>
172.20.5.14 | CHANGED | rc=0 >>
172.20.5.15 | CHANGED | rc=0 >>
172.20.5.21 | CHANGED | rc=0 >>
172.20.5.22 | CHANGED | rc=0 >>
172.20.5.77 | CHANGED | rc=0 >>
172.20.5.23 | CHANGED | rc=0 >>
172.20.5.75 | CHANGED | rc=0 >>
172.20.5.11 | CHANGED | rc=0 >>
172.20.5.78 | CHANGED | rc=0 >>
172.20.5.76 | CHANGED | rc=0 >>