langchain-aws icon indicating copy to clipboard operation
langchain-aws copied to clipboard

Published 20 hours ago • verified publisher icon langchain-ai

feat(community): Add support for Bedrock cross-region inference models

Open keremnalbant opened this issue 5 months ago • 7 comments

Merged for LangChainJS: https://github.com/langchain-ai/langchainjs/pull/6682 Closed PR as the Bedrock is deprecated in langchain-core: https://github.com/langchain-ai/langchain/pull/26038

Hey, I recently I switched using to Bedrock Inference models.

With Inference models, Amazon introduced a new prefix which is a region code. If the modelId previously was anthropic.claude-3-5-sonnet-20240620-v1:0 now, with the change it's eu.anthropic.claude-3-5-sonnet-20240620-v1:0

This PR adds:

  • Support for each AWS Bedrock supported regions.
  • Support streaming for inference models in Converse API

Fixes #186

keremnalbant avatar Sep 08 '24 11:09 keremnalbant