feat: RayServe with NVIDIA Triton server pattern (addressing issue 509)

[freschri]

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted. Consult the CONTRIBUTING guide for submitting pull-requests.

Motivation

This PR is to address https://github.com/awslabs/data-on-eks/issues/509

More

• [ ] Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
• [ ] Mandatory for new blueprints. Yes, I have added a example to support my blueprint PR
• [ ] Mandatory for new blueprints. Yes, I have updated the website/docs or website/blog section for this feature
• [ ] Yes, I ran pre-commit run -a with this PR. Link for installing pre-commit locally

For Moderators

• [ ] E2E Test successfully complete before merge?

Additional Notes

Publishing PR for approach review. A few TODOs:

• complete Triton description
• upload image to a repo within public.ecr.aws/data-on-eks/
• replace the existing image refs in ray-serve-stablediffusion.yaml with new image as per above step

[github-actions[bot]]

This PR has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this PR will be closed in 10 days

[freschri]

This PR has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this PR will be closed in 10 days

removing stale

[freschri]

This PR has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this PR will be closed in 10 days

removing stale

[github-actions[bot]]

This PR has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this PR will be closed in 10 days

[github-actions[bot]]

Pull request closed due to inactivity.