Self-monitoring - System health data in indices to make dashboards and alerts

[thmsbp]

Is your feature request related to a problem? Please describe.

Today, we use these "Dev Tools" commands to check the Cluster status: GET _cluster/health GET _cat/allocation?v GET _cat/nodes?v GET _cluster/stats We would save time consulting or implementing a self-monitoring dashboard and alerts from these sources. Most of our users are not familiar with Dev-Tools and only consult the dashboards. They'd like to know if the monitoring system itself is ok.

Describe the solution you'd like

Having OpenSearch health status data in native indices to build dashboard and monitors. Or a native OpenSearch dashboard to monitor the system health, but we would still need indices to implement the alerts.

Describe alternatives you've considered

We don't want another monitoring system to monitor our Opensearch. We thought about a service getting data from the API and ingesting it into OpenSearch.

Additional context

none

[zhongnansu]

@thmsbp thanks for submitting feature request. Currently we don't have such stack monitoring from Dashboards. It could be a valid use case

Pinging other maintainers to help review the feature request. Also wonder how we move forward with feature request from product side. @AMoo-Miki

[kavilla]

Hello @thmsbp,

Not quite what you are asking for but wanted to call out status. For example, https://playground.opensearch.org/app/status. This can be hit by api/status like https://playground.opensearch.org/api/status.

[thmsbp]

Thanks, I didn't know this status page. It's a nice quick first check. Maybe it's already possible but it would be convenient to have a clickable link somewhere in the main interface to get it (for our Support team) even if the URL is quite easy to remember ... but we have so many things to remember :)

[joshuarrrr]

See also feature request: https://github.com/opensearch-project/OpenSearch-Dashboards/issues/3852

[AMoo-Miki]

I am not sure why this is not already the case but @thmsbp is right that a link to this page should be interfaced somewhere. @kgcreative Do you have any thoughts on where we should add a link to app/status?

[kgcreative]

It should be a sibling to advanced settings in stack management

[kgcreative]

(And probably link to it from Home?)

[smowky]

clickable link would be nice, just found out by coincidence such a page exist