gpustat
gpustat copied to clipboard
Can I get the information about the GPU utilization of each user?
Can I get the information about the GPU utilization of each user?
I don't think nvidia-ml library can report GPU utilization per user. Do you find a solution for that?
No. My leader asked me to write a shell script to monitor everyone's GPU utilization. However, I have no idea and I am looking for a solution for it.
I think this can be implemented using nvmlDeviceGetProcessUtilization
API, which reports encoder/decoder/compute utilization per process.