chatbox icon indicating copy to clipboard operation
chatbox copied to clipboard

[Feature] Add Bedrock integration to support Amazon Titan, Jurassic AI, Anthropic's Models via AWS Account

Open Vrandus opened this issue 1 year ago • 7 comments
trafficstars

Problem Description Please describe the issue or difficulty you are experiencing and why it makes using the software difficult or frustrating.

  • No support for AWS Bedrock's models (AWS Titan, Jurassic AI)
  • No support to use AWS credentials to interface with Anthropic's Claude Model

Proposed Solution Please provide a clear and concise description of what you would like to see in terms of a function or solution.

  • Add support for AWS Bedrock Models, enabling Amazon Titan, Anthropic and Jurassic AI models (and future models) to be able to be used in ChatBox
  • Use AWS credentials to make calls into bedrock hosted models
  • Use AWS Bedrock's unified SDK to add enable all models above at once
    • https://docs.aws.amazon.com/bedrock/latest/APIReference/welcome.html

Additional Context Please provide any additional context or information that would help better understanding your feature request, such as screenshots, examples, or use cases.

Vrandus avatar Jan 26 '24 19:01 Vrandus

需求 +1
Request +1

0x5c0f avatar Apr 12 '24 02:04 0x5c0f

Clause Opus is now available on AWS bedrock. Please add support for AWS bedrock.

stirredo avatar Apr 17 '24 03:04 stirredo

+1

dannysteenman avatar Apr 17 '24 06:04 dannysteenman

+1, support aws bedrock anthropic claude 3 model, https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters-anthropic-claude-messages.html

myoss avatar Apr 18 '24 07:04 myoss

+1 for claude via bedrock please

geekyayush avatar Jul 23 '24 18:07 geekyayush

+1, now we can use claude 3.5 sonnet if enable AWS. And many other open source models.

xiao2c avatar Aug 04 '24 16:08 xiao2c