server icon indicating copy to clipboard operation
server copied to clipboard

Python Backend: How can i add a new labels for all default MetricFamily?

Open nhhviet98 opened this issue 10 months ago • 1 comments

I want to add new labels for ALL default MetricFamily (nv_inference_request_success, nv_inference_request_failure, nv_inference_count,...) in python backend, how can I do that?

Example:

# HELP nv_inference_request_success Number of successful inference requests, all batch sizes
# TYPE nv_inference_request_success counter
nv_inference_request_success{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582

# HELP nv_inference_request_failure Number of failed inference requests, all batch sizes
# TYPE nv_inference_request_failure counter
nv_inference_request_failure{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 0

# HELP nv_inference_count Number of inferences performed (does not include cached requests)
# TYPE nv_inference_count counter
nv_inference_count{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582

Thank you for your help!!

nhhviet98 avatar Apr 11 '24 10:04 nhhviet98

I think It is not possible right now. @rmccorm4 do you think this is something we could add?

Tabrizian avatar Apr 19 '24 21:04 Tabrizian