pipelines icon indicating copy to clipboard operation
pipelines copied to clipboard

[feature] <RuntimeClass> Ability to specify spec.runtimeClassName inside Pod pipeline

Open namirinz opened this issue 6 months ago • 4 comments

Feature Area

In my GPU cluster to make a K8s pod able to use GPU is to specify spec.runtimeClassName: nvidia . (https://kubernetes.io/docs/concepts/containers/runtime-class/#usage)

What feature would you like to see?

Ability to add RuntimeClass Name into the component or task.

Ex.


@container_component
def train_from_csv():
    return dsl.ContainerSpec(
        image="",
        command=["python", "train.py"],
        args=[],
    )

@pipeline(name="complex_pipeline")
def complex_pipeline(kernel: str):
    model = train_from_csv()
    
    ##### HERE ####
    set_runtimeclass_name(task=model, runtimeclass="nvidia")

What is the use case or pain point?

Able to have a component that able to use GPU (ex. Train Model)

Is there a workaround currently?


Love this idea? Give it a 👍.

namirinz avatar Aug 07 '24 17:08 namirinz