MIG slices instead of entire GPUs

[kubernetian]

What would you like to be added:

It would be cool if volcano would be able to handle MIG slices instead of entire GPUs. We are currently successfully using volcano in our ML setup to queue model training. We are trying to switch to GPU slices (MIG) instead of entire GPUs. But when we push vcjobs with slices in we get an error that "not enough resources are available". This error does not happen when we wrap it in a "regular" Kubernetes job.

Would be great to hear some feedback wether this is already on the roadmap or not.

Why is this needed:

Transitioning from whole GPUs to GPU slices, and at this point it looks like volcano can't handle that.

[k82cn]

That's great to have such a feature in Volcano :)

[stale[bot]]

Hello 👋 Looks like there was no activity on this issue for last 90 days. Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗 If there will be no activity for 60 days, this issue will be closed (we can always reopen an issue if we need!).

[stale[bot]]

Closing for now as there was no activity for last 60 days after marked as stale, let us know if you need this to be reopened! 🤗