AI-Gateway icon indicating copy to clipboard operation
AI-Gateway copied to clipboard

Feature Request: Integrate AI Gateway with AWS Bedrock for Multicloud AI Gateway Support

Open hariscats opened this issue 8 months ago • 1 comments

Requesting integration support between AI Gateway and Amazon Bedrock to enable multi-cloud orchestration of AI model endpoints within the AI-Gateway. To support enterprise scenarios where AI services can span multiple cloud providers, it would be valuable for the AI-Gateway to support routing and exposing AI models hosted on AWS Bedrock through APIM for broader model choice than what's available in AI Foundry.

Proposed Solution: Create a connector or integration layer that enables APIM to proxy requests to AWS Bedrock endpoints.

Add configuration support for:

  • AWS authentication (via IAM roles or API keys).
  • Bedrock model routing (e.g., Claude, Titan, etc.).
  • Token tracking and emit metrics policies
  • Custom request/response transformation logic (to match APIM contract standards).

hariscats avatar Apr 13 '25 18:04 hariscats

Thank you for this request! We will consider this integration.

vieiraae avatar Apr 17 '25 10:04 vieiraae