Make pod addressability work even in meshes and drop fallbacks
See exhaustive proposal here: https://docs.google.com/document/d/1vUDC_-qWei81QcjI8ZjZJ0Tc4SswUA1gBTSvBqy6CBY/edit?resourcekey=0-C_Yh8KqcLA6Mcr3CQs5Q1Q.
I'll use this as an umbrella to link PRs to.
/triage accepted
This issue is stale because it has been open for 90 days with no
activity. It will automatically close after 30 more days of
inactivity. Reopen the issue with /reopen. Mark the issue as
fresh by adding the comment /remove-lifecycle stale.
/remove-lifecycle stale
A huge chunk of this is done but it needs a little "pushing over the edge" to finish. We were hitting a wall with this when it was discovered that the mesh setup in serving tests maybe wasn't appropriate. I haven't touched it since. What's left is setting it up on the mesh legs and debugging why it doesn't quite work yet.
/assign
/unassign @nader-ziada
Sorta related is how operators are able to setup istio and prometheus together to allow scraping of metrics
https://istio.io/latest/docs/ops/integrations/prometheus/#tls-settings