spring-ai icon indicating copy to clipboard operation
spring-ai copied to clipboard

Feature request: Add support for Amazon Bedrock prompt caching

Open DEG-7 opened this issue 9 months ago • 0 comments
trafficstars

Hey team, there's good news from AWS bedrock!! It now supports prompt caching for Anthropic and Nova models, and will certainly be a must have for those who use these models in AWS (due to important cost savings).

Here is the official documentation: https://aws.amazon.com/bedrock/prompt-caching/ https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

Thank you for all the effort put into this project. Regards

DEG-7 avatar Feb 08 '25 18:02 DEG-7