pyrra icon indicating copy to clipboard operation
pyrra copied to clipboard

multiple prometheus

Open sstarcher opened this issue 2 years ago • 4 comments

Would it be possible to support multiple prometheus from a single Pyrra? We run the Prometheus operator and create multiple servers in different namespaces.

sstarcher avatar Aug 09 '23 11:08 sstarcher

Either that or the ability to separate the UI and the operator. Where a user could deploy the UI to a Kubernetes cluster without Pyrra and deploy the SLO operator to a cluster with multiple Prometheus.

sstarcher avatar Aug 09 '23 11:08 sstarcher

We run Pyrra at Polar Signals against two Prometheus replicas operated by the Prometheus Operator via kube-prometheus. What exact problems are you seeing that you want to solve? For us, this works fine. The easiest thing to solve deduplication would probably be running the queries through a Thanos Querier in front of the two Prometheus replicas.

metalmatze avatar Aug 09 '23 15:08 metalmatze

Not replicas, but entirely separate prometheus servers with separate metrics. We could certainly run Thanos and rollup metrics, but we specifically don't and don't really want the metrics to comingle.

Currently we could run multiple Pyrras, but it would be better for us if the UI could pull from multiple prometheus servers which is what Grafana does do for us.

sstarcher avatar Aug 09 '23 15:08 sstarcher

Got it. I can see how that might makes sense but is not on the roadmap. For now, you'll have to make the data accessible through the same API or run two Pyrra instances.

metalmatze avatar Aug 10 '23 12:08 metalmatze