litellm-ai-gateway topic
List
litellm-ai-gateway repositories
trafficstars
guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
19
Stars
7
Forks
19
Watchers
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides...
