freschri

feat: RayServe with NVIDIA Triton server pattern (addressing issue 509)

3

### What does this PR do? 🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be...

### Community Note * Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request * Please do...

aws-eks: neuron device plugin manifest better reference

3

### Describe the bug the neuron device plugin addon used in the cdk uses a custom manifest, see here: https://github.com/aws/aws-cdk/blob/f3d74bb78189ec6b76cfa85c97d993c1b26c1cac/packages/aws-cdk-lib/aws-eks/lib/cluster.ts#L1979 which is NOT pointing to the official neuron image (public.ecr.aws/neuron/neuron-device-plugin)...