Ratnopam Charabarti

Add inference serve example to run Stable Diffusion Inference using AWS Inferentia2

5

## Why are these changes needed? This example showcases how to serve Stable Diffusion Inference using AWS Inferentia2 ## Related issue number Closes #43018 ## Checks - [x] I've signed...

[Serve] Add inference serve example to run Stable Diffusion Inference using AWS Inferentia2

9

### Description Add example of how to run inference using RayServe for Stable Diffusion model using AWS Inferentia2. The example will showcase how to leverage AWS Inf2 instances to set...

Inferentia: Test horizontal scaling of Ray Worker Pods

1

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

Add model caching for Stable Diffusion

3

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

### What does this PR do? Adds capability to deploy LLMs for inference on AWS Inferentia with ray and vLLM 🛑 Please open an issue first to discuss any significant...

Create blueprint using S3 mountpoint for external jar files to run Spark workloads

1

### Community Note For Spark workloads requiring additional JARs, it's unnecessary to include these JARs in the base Docker image. These JARs can be developed and maintained by multiple teams...

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

Enhance pull speed for Large ML container Images with Bottlerocket

4

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...