intel-technology-enabling-for-openshift icon indicating copy to clipboard operation
intel-technology-enabling-for-openshift copied to clipboard

Support the Heterogenous(different type of) Intel GPU cards in the same OCP cluster

Open uMartinXu opened this issue 1 year ago • 2 comments

Summary

Support the heterogeneous (different) Intel GPU cards in the same OCP cluster.

Detail

In the Scenario, When in the same cluster, different Intel GPU cards like Max-1100, Flex-140, and Flex-170 are provisioned. A mechanism should be provided for the users to pick up the proper GPU card they want to run the workloads on. To align with the taints/tolerance mechanism from Red Hat OpenShift AI accelerator Profile, We will use the same taints/tolerance mechanism for this feature.

To properly label(taint) the nodes in the cluster automatically, we will rely on the NFD node tainting feature.

So this feature rely on issue https://github.com/openshift/cluster-nfd-operator/issues/356

Note

The feature is for the heterogeneous (different) Intel GPU cards in the same OCP cluster. The different Intel dGPU cards in the same node are not supported.

uMartinXu avatar Mar 04 '24 23:03 uMartinXu

/cc @tkatila

mythi avatar Mar 05 '24 05:03 mythi

The different Intel dGPU cards in the same node are not supported.

This is only because of GAS support, won't rely on NFD labelling taints/tolerations, correct?

How does this align with future resource requests via DRA? It does seem divergent at first glance

brgavino avatar Mar 08 '24 15:03 brgavino