guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks copied to clipboard
aws-solutions-library-samples
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides...
### Proposal The 'Important Setup Instructions' section under 'Quick Start Guide' appears to be lacking detailed information that could aid users in successfully setting up the deployment. It would be...
*Issue #, if available:* *Description of changes:* By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Bumps [transformers](https://github.com/huggingface/transformers) from 4.46.0 to 4.50.0. Release notes Sourced from transformers's releases. Release v4.50.0 New Model Additions Model-based releases Starting with version v4.49.0, we have been doing model-based releases, additionally...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Bumps [ray](https://github.com/ray-project/ray) from 2.39.0 to 2.43.0. Release notes Sourced from ray's releases. Ray-2.43.0 Highlights This release features new modules in Ray Serve and Ray Data for integration with large language...
Metadata
Owner
Metadata
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides...