Support for Amazon Bedrock

Open QuinnGT opened this issue 1 year ago • 2 comments

Is your feature request related to a problem? Please describe. No current support for Amazon Bedrock

Describe the solution you'd like Support added for Amazon Bedrock

Due to privacy concerns with OpenAI and it's sub products, I'd love to use this with Amazon Bedrock. Direct integration with the go SDK would be awesome but either way, love to see this added.

Jan 24 '24 04:01 QuinnGT

Hey @QuinnGT, thanks for the suggestion. We're refactoring how LLM inference works in Zep. We'll consider how Bedrock might be supported. We already support Anthropic models, albeit directly via the Anthropic API and not necessarily via AWS.

Jan 31 '24 00:01 danielchalef

Amazon Bedrock and other inference providers are now supported via a proxy such as LiteLLM.

Oct 03 '24 21:10 danielchalef