marvin icon indicating copy to clipboard operation
marvin copied to clipboard

Add support for Anthropic models via AWS Bedrock

Open cjweber opened this issue 8 months ago • 3 comments

First check

  • [X] I added a descriptive title to this issue.
  • [X] I used the GitHub search to look for a similar issue and didn't find it.
  • [X] I searched the Marvin documentation for this feature.

Describe the current behavior

Marvin currently supports Anthropic, OpenAI, and Azure OpenAI models. There is no way to target AWS Bedrock LLMs.

Describe the proposed behavior

The proposed behaviour is to enable targeting of Anthropic models hosted on AWS Bedrock. I am hoping this could be configured in a way such that existing Anthropic business logic can be leveraged, and integrated with configuration options in order to target one hosted on AWS Bedrock vs the Anthropic API.

Example Use

No response

Additional context

I'm happy to look into contributing if this feature is of interest. If it is not, I would like to understand why! Thank you.

cjweber avatar Nov 13 '23 17:11 cjweber

Happy to contribute to this new feature as well.

Pidem avatar Nov 21 '23 04:11 Pidem

Would be interested in this feature as well.

KoStard avatar Jan 11 '24 15:01 KoStard

@zzstoatzz @jlowin Can I pick this up?

Dev-Khant avatar Apr 11 '24 06:04 Dev-Khant