pipelines
pipelines copied to clipboard
[feature] <RuntimeClass> Ability to specify spec.runtimeClassName inside Pod pipeline
Feature Area
In my GPU cluster to make a K8s pod able to use GPU is to specify spec.runtimeClassName: nvidia . (https://kubernetes.io/docs/concepts/containers/runtime-class/#usage)
What feature would you like to see?
Ability to add RuntimeClass Name into the component or task.
Ex.
@container_component
def train_from_csv():
return dsl.ContainerSpec(
image="",
command=["python", "train.py"],
args=[],
)
@pipeline(name="complex_pipeline")
def complex_pipeline(kernel: str):
model = train_from_csv()
##### HERE ####
set_runtimeclass_name(task=model, runtimeclass="nvidia")
What is the use case or pain point?
Able to have a component that able to use GPU (ex. Train Model)
Is there a workaround currently?
Love this idea? Give it a 👍.