data-on-eks
data-on-eks copied to clipboard
Kueue with Ray
Create a detailed blueprint to set up Kueue with Ray to demonstrate large scale batch processing (training, batch predictions, etc.). Customers are looking into Kueue as alternative to Yunikorn/Volcano as it is a CNCF project and provides k8s native option for advanced scheduling.
We can use existing JARK and trainium-inferentia blueprint to enable this scheduler and showcase the examples rather than creating a new blueprint for this.
I can look at this.