InvokeModelInput has no explicitPromptCaching parameter

[daqingllm]

Acknowledgements

• [x] I have searched (https://github.com/aws/aws-sdk/issues?q=is%3Aissue) for past instances of this issue
• [x] I have verified all of my SDK modules are up-to-date (you can perform a bulk update with go get -u github.com/aws/aws-sdk-go-v2/...)

Describe the bug

Since InvokeModelInput has no ExplicitPromptCaching param, using go sdk can't enable prompt caching. It's a serious problem!

Regression Issue

• [ ] Select this option if this issue appears to be a regression.

Expected Behavior

Support ExplicitPromptCaching

Current Behavior

No ExplicitPromptCaching param for InvokeModelInput

Reproduction Steps

none

Possible Solution

No response

Additional Information/Context

No response

AWS Go SDK V2 Module Versions Used

v1.8.3

Compiler and Version used

1.20

Operating System and version

mac

[Madrigal]

related to #2986

Need Bedrock Runtime to release updated models to the SDK

[awartoft]

@Madrigal when can we expect an update?

[Madrigal]

We shared this with Bedrock team. We unfortunately don't have an ETA

[KevinZhou1]

Any update?

[Madrigal]

This is now supported by Bedrock, see #2986

Note however that the InvokeModelInput uses an untyped Body member, so you need to adapt the example there to work with InvokeModel

[github-actions[bot]]

This issue is now closed. Comments on closed issues are hard for our team to see. If you need more assistance, please open a new issue that references this one.