devices icon indicating copy to clipboard operation
devices copied to clipboard

Published 20 hours ago • verified publisher icon volcano-sh

Add MIG Device support

Open zamog opened this issue 3 years ago • 2 comments

Adding support for MIG devices - the pull request is still WIP - only to review general idea #20

zamog avatar Dec 15 '21 21:12 zamog

@zamog , that's great! would you help to share more background for this enhancement?

k82cn avatar Dec 15 '21 23:12 k82cn

Background: Multi-Instance GPUs (MIG) allows partitioning GPUs into multiple instances. We saw a significant performance increase when MIG was enabled compared to running a few jobs on the same physical GPU. More info on Nvidia site

Notes:

  1. NVIDIA_VISIBLE_DEVICES changed to use UUID.
  2. The memory units must be changed to HundredMB or Gig to support the new GPUs (40/80 Gig)

zamog avatar Dec 28 '21 07:12 zamog