generative-ai-application-builder-on-aws
generative-ai-application-builder-on-aws copied to clipboard
Add Claude 3.7 (Thinking) as available models
Adding claude 3.7 to the configs is easy but the solution doesn't currently support thinking or caching parameters. Please add these to the solution would be extremely helpful.
Hi @jruokola , thanks for the question.
Glad you got Claude 3.7 working with relative ease! Just wanted to also let you know that Claude 3.7 is available out of the box for the solution using the Inference Profiles feature of the solution.
Regarding support for more model parameters, we have plans to support greater flexibility when invoking your models and intend to release that as a part of our next minor/major release. I expect the use the parameters you mention above should be supported more natively.
I will notify you here in this issue when the release is available and these capabilities are supported.
Thanks again for the request!
Hi @jruokola , this is now supported in the latest v3.0.0 release of GAAB. See the screenshot below for an example on how to use it.
Additionally, here is the Amazon Bedrock documentation page describing how to use extended thinking and restrictions. Be sure to follow these details to avoid getting errors during your chat experience (for example, temperature must be = 1).