azure-metrics-exporter icon indicating copy to clipboard operation
azure-metrics-exporter copied to clipboard

Can this exporter support azure batch API for getting metrics , if not in future releases can we expect this feature?

Open tharun2258 opened this issue 1 year ago • 5 comments

Reference API :

POST /subscriptions/<subscriptionId>/metrics:getBatch?metricNamespace=&api-version=2023-03-01-preview

Microsoft documentation for batch API to get metrics:

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-batch-api

tharun2258 avatar Dec 18 '23 12:12 tharun2258

@jkroepke Kindly update any updates on this issue and kindly ask any additional details required for this issue

tharun2258 avatar Jan 05 '24 12:01 tharun2258

Hi @tharun2258 is an reason mention me? I'm not an maintainer here.

jkroepke avatar Jan 05 '24 17:01 jkroepke

@mblaschke The quest may solve some Rate limit issues that exists with azure-metrics-exports.

The batch API is already availble, but not in armmonitor SDK package. Instead there is an dedicated monitor/azquery package which seems to be optimized for fetching metrics. https://github.com/Azure/azure-sdk-for-go/tree/main/sdk/monitor/azquery.

jkroepke avatar Jan 05 '24 17:01 jkroepke

Hi @tharun2258 is an reason mention me? I'm not an maintainer here.

Hi , Okay thanks for the reference link and information shared.

tharun2258 avatar Jan 08 '24 05:01 tharun2258

@mblaschke @jkroepke

We are currently using Azure Metric Exporter (Prometheus exporter), which is now part of Grafana agent for scraping Azure resource metrics. The Azure metric exporter is mainly based on Azure monitor REST API, which has a throttling limit of 12,000 per principal id and per subscription. Recently, Microsoft introduced the Batch API (Data Plane API), which has a throttling limit of 360,000. They recommend switching to the Batch API from the REST API (links provided below).

Do you have any plans to incorporate the Batch API in Azure Metric Exporter? If so, could you please provide a high-level timeline?"

Reference links:

https://techcommunity.microsoft.com/t5/azure-observability-blog/azure-monitor-announcing-public-preview-of-azure-metrics-data/ba-p/3805986

https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/migrate-to-batch-api?tabs=individual-response

tharun2258 avatar Jan 09 '24 02:01 tharun2258