AI-Gateway
AI-Gateway copied to clipboard
Feature Request: Integrate AI Gateway with AWS Bedrock for Multicloud AI Gateway Support
Requesting integration support between AI Gateway and Amazon Bedrock to enable multi-cloud orchestration of AI model endpoints within the AI-Gateway. To support enterprise scenarios where AI services can span multiple cloud providers, it would be valuable for the AI-Gateway to support routing and exposing AI models hosted on AWS Bedrock through APIM for broader model choice than what's available in AI Foundry.
Proposed Solution: Create a connector or integration layer that enables APIM to proxy requests to AWS Bedrock endpoints.
Add configuration support for:
- AWS authentication (via IAM roles or API keys).
- Bedrock model routing (e.g., Claude, Titan, etc.).
- Token tracking and emit metrics policies
- Custom request/response transformation logic (to match APIM contract standards).
Thank you for this request! We will consider this integration.