monitoring icon indicating copy to clipboard operation
monitoring copied to clipboard

Grafana chart loses history when the leader changes

Open gregwebs opened this issue 5 years ago • 4 comments
trafficstars

somewhat like #2. Grafana shows information for each PD even though it only has it for the PD leader. Then if the leader changes the chart for the new leader won't have history from the old.

It seems like a lot of our monitoring does not handle a PD leader change well.

gregwebs avatar Dec 13 '19 20:12 gregwebs

Yes, you have to choose the leader to view PD's dashboard. For old history, you have to select a time window that does not have leader change, and select the old leader to view the dashboard.

tennix avatar Dec 14 '19 00:12 tennix

Is it possible we can have a continuous view of the leader?

gregwebs avatar Dec 16 '19 14:12 gregwebs

Is it possible we can have a continuous view of the leader?

Seems no, because only PD leader reports metrics.

tennix avatar Dec 16 '19 14:12 tennix

Will it help if we remove the instance label? It seems like there should be a way to merge theses into 1.

gregwebs avatar Dec 16 '19 15:12 gregwebs