Add observability on endpoints

[amvanbaren]

Observability should help to gain insights in usage, errors and latencies of OpenVSX server. Issue https://github.com/EclipseFdn/open-vsx.org/issues/713 contains more info on how to implement the feature.

EDIT: we need RED metrics to upstream (open-vsx.org) as well to know when we should escalate issues to Eclipse Foundation. If we measure only from clients or only requests to self-hosted installation it could look that everything is alright because of backup while upstream experiencing issues.

[kineticsquid]

@amvanbaren Where would these metrics show up, e.g. at https://status.open-vsx.org/?

[amvanbaren]

I'd say this is more for internal use. To monitor the system and set alerts for when it doesn't perform as expected (too slow, too many errors, etc.). You can of course expose the (read only) dashboard at https://status.open-vsx.org

[kineticsquid]

I'm assuming these will show up on a dashboard, internal or external. Do we have a mock up? Or can you point to an example of what it might look like?

[kineticsquid]

@amvanbaren Where do we see this information from this additional instrumentation?

[amvanbaren]

@kineticsquid https://openvsx.grafana.net

[kineticsquid]

@amvanbaren I think you'll have to give me a demo. I can see the dashboard, but not any real info.

[amvanbaren]

@kineticsquid Ok, let's schedule a demo