marvin
marvin copied to clipboard
Add support for Anthropic models via AWS Bedrock
First check
- [X] I added a descriptive title to this issue.
- [X] I used the GitHub search to look for a similar issue and didn't find it.
- [X] I searched the Marvin documentation for this feature.
Describe the current behavior
Marvin currently supports Anthropic, OpenAI, and Azure OpenAI models. There is no way to target AWS Bedrock LLMs.
Describe the proposed behavior
The proposed behaviour is to enable targeting of Anthropic models hosted on AWS Bedrock. I am hoping this could be configured in a way such that existing Anthropic business logic can be leveraged, and integrated with configuration options in order to target one hosted on AWS Bedrock vs the Anthropic API.
Example Use
No response
Additional context
I'm happy to look into contributing if this feature is of interest. If it is not, I would like to understand why! Thank you.
Happy to contribute to this new feature as well.
Would be interested in this feature as well.
@zzstoatzz @jlowin Can I pick this up?