govmomi : add vSAN high resolution Stats Support ( New Metrics / Query Specs to VSAN as of esxi 8u1 )

[Muy69]

Update so that high resolution stats can be pulled.

New Query Specs would be :

'hr-cluster-domclient', 'hr-cluster-domcompmgr', 'hr-host-domclient', 'hr-host-domcompmgr', 'hr-vsan-vnic-net', 'hr-vsan-host-net', 'hr-vsan-pnic-net', 'hr-rdt-net', 'hr-vsan-tcpip-stats', 'hr-vsan-esa-disk-layer', 'hr-vsan-esa-disk-scsifw', 'hr-vsan-esa-dom-scheduler', 'hr-cache-disk', 'hr-capacity-disk', 'hr-disk-group', 'hr-zdom-io', 'hr-zdom-vtx'

If the Metrics are avaible , other Application as Telegraf will benefit and extract such Metrics . With such support those High Resolution Stats Metrics can be used to get 30sec Polling Intervals to the VSAN ESA Layers, same as you will see currently only in the "Real Time" UI in vSphere

Currently the VSAN Option provides only 300sec ( 5Minutes) Polling interval which is inadequate for a Storage Device of such magnitude like VSAN ESA as all the Spike will not be traceble.

On the Explore 2024 we have asked the ARIA Team why such Polling intervall for VSAN ESA ( 30sec) are not avaible and they gave the info that the Telegarf Tool is not able to provide such Metrics to ARIA currently , only the default Polling Intervall of 300sec.

I linked the current VSAN Module under the VSPHERE Module of Telegraf to show that the High Resolution stats are missing.

https://github.com/influxdata/telegraf/blob/master/plugins/inputs/vsphere/vsan.go

[github-actions[bot]]

Howdy 🖐   Muy69 ! Thank you for your interest in this project. We value your feedback and will respond soon.

If you want to contribute to this project, please make yourself familiar with the CONTRIBUTION guidelines.

[dougm]

Hi @Muy69 , also saw your comment here: https://github.com/vmware/govmomi/issues/3375#issuecomment-2479071702

I don't know any details on vSAN metrics. If you have pointers to any docs, examples in other languages, etc., please drop them in here. I will ask around internally to folks who might also have some pointers.

[Muy69]

Hi @dougm do you maybe had the chance to get more Insight ?

The Metrics were given to me a Member of VMWARE / Palo Alto . I you are intrested I can PM you the Name ?

If I cant pull the metrics via govmomi API, I will not have the ability to update Telegraf with the given Metrics.

[Muy69]

Hi @dougm @akutz ,

there is vcf9 on the sunrise , as it is using Telegraf Agent too, do you maybe have an estimate when govmomi will finally have the full API Implementation ?

My other Request to support the Full vSphere API since 8u1 seems to get closed without any Info or Progress purely because of Time . I would like to help that those API could be implemented , what can I do to help that it is implemented and therefor other Tools like Telegraf can benefit from those changes ?

[Muy69]

Those High Resolution Metrics are descirbed also here , these new Metrics are really helpful as they enable the customer to have a better Monitoring on high Performance Storage such as VCF Storage ( vSAN 8 ESA ) . Im under the impression that those new Metrics are not communicated pretty good yet even on the Explore 2024 I was told that they dont "exist" , as currently they are not avaible under VMware Cloud Foundation 5.x I was told.

https://blogs.vmware.com/cloud-foundation/2023/03/22/high-resolution-performance-monitoring-in-vsan-8-u1/

[github-actions[bot]]

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Mark as fresh by adding the comment /remove-lifecycle stale.

[Muy69]

Hi @dougm what kind of Info would you require to get more insight with that Request ? As VCF 9 is coming up , I still think that the Rquest is helpful .

[akutz]

For reference, this is the API that will need to be used -- https://developer.broadcom.com/xapis/virtual-infrastructure-json-api/latest/v-san-service-api/vsan-performance-manager/.

I responded internally to the question When will this be implemented with the following:

The answer to your question is whenever someone wants to open a pull request. GoVmomi is maintained as best-effort by folks that want to work on it. Right now that is mostly just myself.

As this is non-generated code, the bar to implement this is higher than most other requests. That is to say, there are no immediate plans to make this happen. Anyone is welcome to open a PR however. I will gladly review it.

I will also take a look when I have a free moment. Some notes:

• A new package needs to be created, ./vapi/vsan
• The code to implement the request will live there

Some questions:

• Is govc support requested/required?
• Is vC Sim support requested/required?

[Muy69]

@akutz It is only govmomi required in the Telegraf context , that would greatly help , particullary now with VCF 9 and the new VSAN Metrics . VMWARRE will also benefit from it as VCF Operation is based on the telegraf funktionality .

Im sorry and I know it is not easy but I try to get that be done since vSphere 8 u2 , maybe someone give you the Prio to schedule that ?

[github-actions[bot]]

This issue is stale because it has been open for 90 days with no activity. It will automatically close after 30 more days of inactivity. Mark as fresh by adding the comment /remove-lifecycle stale.