server
server copied to clipboard
Python Backend: How can i add a new labels for all default MetricFamily?
I want to add new labels
for ALL default MetricFamily
(nv_inference_request_success
, nv_inference_request_failure
, nv_inference_count
,...) in python backend
, how can I do that?
Example:
# HELP nv_inference_request_success Number of successful inference requests, all batch sizes
# TYPE nv_inference_request_success counter
nv_inference_request_success{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582
# HELP nv_inference_request_failure Number of failed inference requests, all batch sizes
# TYPE nv_inference_request_failure counter
nv_inference_request_failure{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 0
# HELP nv_inference_count Number of inferences performed (does not include cached requests)
# TYPE nv_inference_count counter
nv_inference_count{gpu_uuid="GPU-0980dd8d-7304-ae3d-fadf-11882051f161",model="model_name",version="1", new_label="new_label_value"} 8582
Thank you for your help!!
I think It is not possible right now. @rmccorm4 do you think this is something we could add?