dspy icon indicating copy to clipboard operation
dspy copied to clipboard

DSPy framework and support for AWS BedRock

Open deepuak opened this issue 6 months ago • 2 comments

hi,

Can someone please let me know whether DSPy framework support models hosted on AWS Bedrock? And can I use dspy.OpenAI() for Bedrock as well? It would be really great if someone can share me an example of dspy.OpenAI() with bedrock endpoint.

deepuak avatar Feb 28 '24 11:02 deepuak

Hi @deepuak ,

DSPy supports AWS Bedrock! Check out dspy.Bedrock and the underlying AWSLM class.

You can use this directly dspy.Bedrock(region_name=..., model=..., ...) instead of dspy.OpenAI().

arnavsinghvi11 avatar Feb 28 '24 18:02 arnavsinghvi11

thank you!

deepuak avatar Feb 29 '24 14:02 deepuak

Documentation - DSPy AWS Provider

subhsaha avatar Jun 30 '24 06:06 subhsaha