Spike open telemetry in SDK

[Eric-Warehime]

Problem

We want validators to be able to expose anonymized data about the state of the networks they are running.

Closing criteria

Develop a plan for pushing metrics to a centralized server (potentially upstream in the SDK).

Problem details

[Eric-Warehime]

In SDK we have prometheus metrics.

Goal for us:

• Be able to push instead of pull prom data
• Have this be configurable via app params/config
  • can default to off, can specify the endpoint being pushed to, other params controlling frequency, etc.
• Follow up w/ optionally adding logging data, tracing

go-metrics interface != collector or opentele primitives

[wllmshao]

https://github.com/cosmos/cosmos-sdk/pull/24158