multi-model-server icon indicating copy to clipboard operation
multi-model-server copied to clipboard

Published 20 hours ago • verified publisher icon awslabs

Add GPU metrics to metrics logging

Open mikeobr opened this issue 5 years ago • 1 comments

Currently MMS_METRICS that are logged include things like CPUUtilization and Memory usage. It would be great if these also included things like GPU usage and memory.

This would make it easier to track how well we are utilizing a server's GPU resources as well as diagnose out of memory issues.

Thanks!

mikeobr avatar Jun 27 '19 19:06 mikeobr

@mikeobr : Thanks for raising this issue. We will look into how to get functionality in.

vdantu avatar Jun 27 '19 19:06 vdantu