Bedrock Claude 3.7/3.5v2 Prompt caching support

[kevo1ution]

trafficstars

What Would You Like to See with the Gateway?

Prompt caching is now generally available for 3.7 sonnet, and in preview mode for 3.5v2

https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

Context for your Request

Prompt caching lowers latency of requests, and reduces token usage

Your Twitter/LinkedIn

https://x.com/kevo1ution