MikeQDev

icon indicating a website link https://srezone.com/blog/

icon location SRE icon location Making production systems more reliable, one engineer at a time. Also building https://cabinsaver.com/ for solo cruisers 🚢

Results 1 issues of MikeQDev

🚀 Feature: Add prompt caching for Bedrock Converse

3 comment

### Which component is this feature for? Bedrock Instrumentation ### 🔖 Feature description Support tracking of [prompt caching](https://aws.amazon.com/blogs/machine-learning/effectively-use-prompt-caching-on-amazon-bedrock/) in Bedrock **Converse**. Prompt caching telemetry for Bedrock Converse will be: -...