intel-extension-for-pytorch icon indicating copy to clipboard operation
intel-extension-for-pytorch copied to clipboard
verified publisher icon intel

Add an API to get current global free memory of XPU

Open notsyncing opened this issue 1 year ago • 1 comments

This PR fixes https://github.com/intel/intel-extension-for-pytorch/issues/522, using ZES_ENABLE_SYSMAN environment variable to make it work. It also adds a torch.xpu.mem_get_info() method which behaves the same as torch.cuda.mem_get_info().

Sadly it only works under root. I have opened https://github.com/oneapi-src/level-zero/issues/133 but got no response yet.

Any ideas?

notsyncing avatar Mar 02 '24 13:03 notsyncing

So by https://github.com/oneapi-src/level-zero/issues/133, this requires root user or CAP_PERFMON to work. I'm not sure if Intel is going to add a non-privileged API to get this info. Any updates?

notsyncing avatar Apr 03 '24 06:04 notsyncing